v3.3.0

..Darwin Core Export / DOI Integration .....

Note:

Webconfig needs to be updated!

Workspace changes:

• Workspace changes: 3.2.1..3.3.0

Database Update(s):

• Update script version 3.2.1 to 3.3.0:
• Update_Script_3.2.1_3.3.0.sql

New/Updated Settings

• General/Landing Page - (if empty, load landingpage.htm from tenant)
• Data Colletion/Use external metadata form (Enables the loading of an external metadata form when editing entities)
• Data Colletion/External metadata form destination url (Define the origin from where the external metadata form should be loaded)
• Data Dissemination/gbifCollectionArea - Define a destination of all darwin core archives (Default: {Data}/export/gbif).

Changes

Enhancements

• DOI Integration into BEXIS2 Core System (#1567)
• Improve authorization for internal API calls (#1730)
• Handling of JWT: Store JWT in the page component in bexis2-core-ui - sveltekit (#1694)
• Security improvements: prevent web applications potentially vulnerable to clickjacking (443/tcp) & Add missing secure cookie attribute (HTTP) (443/tcp) (#1708)(#1707)
• Add the possibility to use an external metadata form instead of the existing one #1715 (#1715)
• Instead of Application Name, The breadcrumb from the old layout shows Home at first element #1720 (#1720)
• Add Page Content to edit content pages in frontend #1693 (#1693)
• RPM: handle missing value in domain constraints - import from dataset(#1692)
• Use the new “meaning” object to store linkage to the needed Darwin Core concepts for variables (#1574)

Bugfixes

• Fix after changing the data structure, the validation should be triggered again (#1729)
• Fix performance problems with several svelte pages (#1717)
• Fix edit data structure allows edit display pattern but can't store the changes (#1709)
• Fix Telerik data table not working (#1727)
• Fix edit variable template: save does not get activated (#1711)
• Fix create new meaning not working (#1714)
• Fix return to dataset after editing data structure not working (#1728)
• Fix destroyed metadata form appears when show data or other tabs in show dataset view (#1710)
• Fix Read a file with delimiter inside the text quotes is not working (#1753)

v3.2.1

in this release 2 bugs were fixed for the mapping and delete dataset landingpage.

Workspace changes:

• Workspace changes: 3.1.0..3.2.0

Database Update(s):

• Update script version 3.2.0 to 3.2.1:
• Update_Script_3.2.0_3.2.1.sql

Changes

Bugfixes

• Fix metadata Mapping: update transformation rule throw a error (#1695)
• Fix landing page of a deleted dataset showed incorrect information (#1696)
• Fix Data Request not working #1702

v3.2.0

This release focused on updating UI libraries, fixing bugs, adding new constraint features, and adding the first version of the new primary data for testing.

Workspace changes:

• Workspace changes: 3.1.0..3.2.0
• Please make sure that the credentials file in the workspace is no longer needed (since 3.1.0). Instead, the SMTP settings are entered in the general settings.json. Please enter your credentials there.

Database Update(s):

• Update script version 3.1.0 to 3.2.0:
• Update_Script_3.1.0beta_3.2.0.sql

Important notes:

• Data Out API: Previously missing values for dates have not been replaced, while all other types have been replaced.

Changes

Enhancements

• SvelteKit Update to version 2.x (#1528)
• First version to replace primary data Telerik table and add a link to My Data view (#747)(#1665)
• Create a domain list based on an internal dataset (#1421)
• Create Dataset: Add copy a dataset (was missing after refactoring in version 3) (#1634)
• Add new DateTime Pattern (yyyy-MM-dd hh:mm: ss/dd.MM.yyyy hh:mm:ss) (#1677)

Bugfixes

• Fix file reader data preview view is not scroll-able (#1637)
• Fix different background colors for menu (#1654)
• Fix missing values for dates are not replaced in the primary data view (within the new primary data view) (#641)
• Fix date display patterns are not replaced in Data Out API (#1549)
• Fix Structure API - Error when a variable has no variable template (#1664)
• Fix Link dataset: can't select a dataset to be linked (#1568)

v3.1.0

This release focused on fixing found bugs or already identified necessary changes in version 3.0.0-beta. Thanks to all testing version 3.0.0-beta!

Workspace changes:

• Workspace changes: 3.0.0-beta..3.1.0
• please take care that the credentials file in the workspace is no longer needed, instead the smtp settings are entered in the general settings.json. please enter your credentials there.

Database Update(s):

• the update script from version 2.18 to 3.0.0-beta has been revised, and errors were fixed.
• Update_Script_218to300.sql
• Update script version 3.0.0-beta to 3.1.0:
• Update_Script_3beta_3.1.0.sql

New Settings:

• Data Structure - Enforce Primary Key (bool): To set a primary key during the creation of a data structure is/is not mandatory.
• Data Structure - Primary Key changeable (bool): Once data is uploaded, it is/is not possible to change the primary key. The new key is only saved if a validation is passed against all linked datasets.

Changes

Enhancements

• Add help on toggle and code editor (#1516)
• Revise help texts (#1486)
• Add display name to settings (#1317)
• Preparations to replace primary data Telerik Table (#747)
• Support default values for elements and attributes during XSD import (#1262)
• support XSD attributes during metadata export (#1071)
• Move SMTP and LADP configuration inside general.settings.json (#1551, #796)
• Reorder table header for Entity Links (#1565)
• Create data structure: filter should show the exact match first (#1541)
• Check and allow units from templates over associated dimensions instead only of the unit itself (#1544)
• Add text to icon for toggle between view & edit (#1426)
• Adjust UX writing under and for "Data Description" (#1561)
• Change type "link" to "vocabulary" in DWC seed data (#1584)
• Improvesubmit in edit dataset (#1415)
• DB Update: Create meanings based on converted variable templates from existing instances (#1538)
• Data Upload: Check the primary key over all uploaded files (#1283)
• Add DWC terms as seed data as meanings (#1510)
• Add help within create & edit data structure (#1490)
• Update constraints with warning (#1420)
• File upload: Add description to file and show under view (#1570)
• Several small improvements (#1545)
• Entity templates: Extend setting defaults permission by other options (#1575)
• Detect and handle different encodings of uploaded files (#1617)

Bugfixes

• Fix missing measurement system validation when creating and editing a unit Type (#1598)
• Fix missing entity ref in datasets or other entity instance dependencies(#1600)
• Fix load metadata failed when loading different datasets with different metadata structures (#1597)
• Fix search index failed when the template of variable is null Type (#1591)
• Fix several download problems (#1587)
• Fix metadata attributes of container elements that don`t appear in the metadata form (#1263)
• Fix if the data structure is created from empty, the meanings are not stored (#1580)
• Fix required fields in the entity template are empty if no mapping to system keys exists at all (#1558)
• Fix token link is broken in Svelte layout (#1520)
• Fix update issues: Metadata can not be edited (#1557)
• Fix metadata export for new imported metadata structure are not working(#1572)
• Fix create page has a dependency on EntityTemplate management (#1577)
• Fix send request is not available (#1576)
• Fix Error on API data out when the header is used and the first column/variable is not of type string (#1546)
• Fix data API: token invalid (#1562)
• Fix API upload doesn't update system variables in metadata (#1391)
• Fix filter position for search is not correct (#1559)
• Fix manual metadata and data is not linked (#1540)
• Fix Swagger API view is not working (#1536)
• Fix the name of the version view model (VersionsModel -> ReadVersionsModel) (#1530)

v3.0.0-beta

Please note that this is a beta version. It is not recommended to use this version in production.

BEXIS2 version 3.0.0 is a major release. It contains a lot of changes in the background as well as in the UI. The most important changes are listed below.

From this release, semantic versioning is used. The version number is composed of three numbers: major.minor.patch. The major version number is increased if there are breaking changes. The minor version number is increased if new features are added. The patch version number is increased if bugs are fixed.

Instructions for updating from 2.18.2 to 3.0.0-beta

Workspace changes:

• all settings.xml are converted to JSON. Transfer your individual settings via the new Settings UI after the update of the code and workspace
• updated EntityReferenceConfig.Xml:
  • removed: IsCompiledBy & Compiles;
  • description revision (if used compile before you should add again)
• Workspace changes: 2.18.2..3.0.0-beta

Database Update(s):

• very important: backup your database before you start the update

• the underlying database structure has changed and extended. Data will be migrated, but a few SQL statements need to be adjusted

  • please create your entity templates and update them according to your datasets and entity template IDs after the update with the provided SQL

• Update_Script_218to300.sql

Changes

General Backend

• Update of the .net framework to 4.8, nhibernate 5.3, and other libraries
• Integration of the Vaiona library into the code
• Improvements and setting up of Jenkins pipeline for development and deployment
• Unit tests were added to most of the refactored backend functions
• Revision of initial seed data for units, dimensions and data types
• JWT support for authentication (#1276)

General Frontend

• Replacing Bootstrap by TailwindCSS and the UI framework Skeleton for all refactored UI components
• Creation of BEXIS2 Core UI NPM Packages for centralized maintenance of certain frequently used UI components like forms and tables. (help, page, forms …) (npm, BEXIS2 Core UI Website)
• Basic setup for E2E tests with playwright (see here)
• Refactoring and enhancement of UI Elements related to the menu, settings, entity templates, data description, and upload workflow have been refactored to Svelte. The remaining parts of the UI follow step by step.
• Replacing of the header – content dividing block by a breadcrumb
• Settings for modules to adjust, e.g., values or default text have a UI and can be changed without server access. This covers only settings which does not require a server restart.
• Introduction of show/hide-able components (e.g., attachments, links, permissions) via entity templates instead of a global setting. Permissions currently not shown, but will be added again in the future.
• Dashboard: Rename to "My Data" (#333)

Bugfixes

• Fixed: Wrong metadata system value for id, if file deleted in a dataset (#1346)

Refactoring dataset creation, data description and upload

• Introduction of Entity Templates (see Entity Templates)
• Extended / changes Variable Concept (see Variable Concept)
• The different upload workflows have been combined to one. The user can freely decide which step he like to start. Create data structure or upload file. Validation is triggered automatically once the file or the data structure has changed.
• Increased level of detail for validation errors
• Data structures can be detected after uploading a file. The data type is analyzed using a random sample (value changeable in the settings). Descriptions can be read. Units can be read and will be mapped to existing units. Missing values can be added for each column.
• Variable Templates are now treated as templates and no longer actively linked and used once selected for a variable. Instead, all information is copied to a variable.
• Data structures are now optional. The unstructured type (for files) has been removed in favor of forcing information to be added in the metadata / not replicated.
• Excel upload is in the current version not possible, but it will re-introduced in the future.
• Excel Macros within the data structure are not supported anymore. The data structure is now a simple Excel file.
• The upload of files is now possible via drag and drop. The upload of multiple files is possible.
• Created datasets are currently not added to the search index, before the upload is finished or metadata has been edited. This might change in the future back to the old behavior.

DOI

• DOI registration at DataCite is now possible via the UI. DOI support is only available for instances of having an account at DataCite.

v2.18.2

Database update: Update_Script_2181to2182.sql

Workspace changes: 2.18.1...2.18.2

Bugs

• Mismatch between Values & linked Parties in Metadata (#1322)

v2.18.1

Database update: Update_Script_218to2181.sql

Workspace changes: 2.18...2.18.1

Bugs

• Fix hangs when loading data structures linked to datasets that have been deleted (#1222)
• Fix Attachment Typos (#1194)
• Fix Delete Attachment: system key not triggered & dataset version overwritten (#1179)

v2.18

Database update: Update_Script_217to218.sql

API changes: Attention the api calls for metadata, data and dataset have been extended and changed with regard to versions.
in general, the calls work according to the following pattern

api/{name}/{id}/{version}

api/{name}/{id}/version_number/{version_number}

api/{name}/{id}/version_name/{version_name}

Workspace changes: 2.17.1...2.18

Features

• Deleted Datasets: Adjust info text, add reason and allow metadata view (#1099)
• Version API: Add (#1028)
• Export a single dataset to darwin core archive format (v1) (#917) - how to setup?

Enhancements

• Metadata API: Unify API calls and add version number and name (#1101)
• Metadata API: Update to get values in the structure of the concept (#1093)
• Search: Order items column-wise instead of row-wise when clicking on "more" in the facets (#1089)
• Darwin Core: Create Concept for DWC Metadata needed Attributes (#1092)

Bugs

• Fix Requests are sent to old owner after change (#1108)
• Fix Metadata Edit: xsd element type "xs:boolean" always disabled (#1106)
• Fix Download data: Fails with filter if special characters in dataset title (#1105)
• Fix Tabular primary data display problem "Displaying items 0 - 0 of 0" (#1116)
• Fix Leading empty line inside each metadata input field (#1117)
• Darwin Core archive: Add documentation to dim manual enhancement (#1104)
• Code cleanup: Remove duplicate folder & consolidation of hamdi1992/core:master and bexis2/core:rc (#1107) (#1066)

v2.17.1

Database update: Update_Script_217to2171.sql

Workspace changes: 2.17...2.17.1

Bugs

• fix dropdown is not locked in metadata view mode
• fix all optional blocks allways active in metadata (#1094)

v2.17

Web.config update to add Exceptionless -> see: 8b50510
Database update: https://github.com/BEXIS2/Core/blob/rc/database%20update%20scripts/Update_Script_216to217.sql

Workspace changes: BEXIS2/Workspace@2.16...2.17

Features

• Adding Exceptionless for System Loggging/Monitoring (#1040)
• Add attributes during XSD import, show and edit (#1050)

Enhancements

• Metadata API: Add check for public (#1037)
• Metadata API: Add request by version (#1036)
• Dataset API: Add title (#1075)
• Metadata Statistic API: Exclude ds, add regex and metadata structure (#1014)
• Schema Mapping: User should be able to map a key to a default value if no field matches (#1048)
• Schema Mapping: (Automatic) bidirectional mapping (#1008)
• Schema Mapping: Convert hard coded system keys of B2 to a dynamic list enhancement (#963)
• SAM - Former member feature: Add tests (#920)
• SAM - Former member feature: Add documentation (#921)
• LDAP Login: Check of "null" or "empty" email addresses (#1067)
• Set/Unset Public: Send email to Admin (#1026)
• Dataset Download: Adapt text in Download-Button of unstructured datasets (#1030)
• Code Cleanup: Removal of unnecessary rpm projects (#1065)
• Wiki page for E2E tests recordings for Data Manager (#1010)

Bugs

• Fix row count to hide Excel download not always correct bug (#1046)
• Fix wrong mail subject if you revoke status (Former Members) (#1073)
• Fix change to former member return always true (Former Members) (#1043)
• Fix after deleting a dataset users are not able to change the permissions (#1033)
• Fix attachment uploads does not trigger system key (e.g. version) update in metadata (#1045)
• Fix Swagger API should not read non-XML files (#1035)
• Fix empty metadata container (#1039)
• Fix XSD import set elements as complex type, when no datatype is defined (#1034)
• Fix during user registration relationships title has an additional colon (#1057)
• Fix prevent send notification email on video preview (#1024)
• Fix authorization via API: Make http authorization header field name handling case-insensitive (#1023)
• Fix missing try/catch within FromExcelSerialDate(data import) (#1068)
• Fix missing try/catch for better error handling (email service) (#1060)