Skip to content

Commit b7a9c93

Browse files
RounakDhillon“RounakPrajwal214Copilot
authored
Docs: 1.10.0 Release Updation (#503)
* Docs: 1.10.0 Release Updation * Update content/partials/v1.11/releases/1.10.0.md Co-authored-by: Copilot <[email protected]> * Update content/partials/v1.11/releases/1.10.0.md Co-authored-by: Copilot <[email protected]> * Update content/partials/v1.11/releases/1.10.0.md Co-authored-by: Copilot <[email protected]> * Update content/partials/v1.11/releases/1.10.0.md Co-authored-by: Copilot <[email protected]> * Update content/partials/v1.11/releases/1.10.0.md Co-authored-by: Copilot <[email protected]> * Update content/partials/v1.11/releases/1.10.0.md Co-authored-by: Copilot <[email protected]> --------- Co-authored-by: “Rounak <“[email protected]”> Co-authored-by: Prajwal214 <[email protected]> Co-authored-by: Copilot <[email protected]>
1 parent 8ba31a2 commit b7a9c93

File tree

2 files changed

+248
-194
lines changed

2 files changed

+248
-194
lines changed

content/partials/v1.10/releases/1.10.0.md

Lines changed: 124 additions & 97 deletions
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,8 @@ You can find the GitHub release [here](https://github.com/open-metadata/OpenMeta
1010

1111
### Impact Analysis & Enhanced Lineage
1212

13+
{% youtube videoId="Nlrz07SBK3c" start="0:00" end="2:04" width="800px" height="450px" /%}
14+
1315
Updated capabilities for tracking downstream impact to tables, ML models, and dashboards from any source table. The Impact Analysis view includes contact information for stakeholders, helping users identify whom to reach out when making schema changes, addressing quality issues, or planning other table modifications.
1416

1517
- This new view will speed up issue resolution and troubleshooting, helping to fix broken processes within the organization.
@@ -23,12 +25,23 @@ The main changes have been around the Java SDK, where we are adopting a Fluent A
2325

2426
The existing Python SDK is still going to be internally used for the Ingestion Framework, but we recommend users to review the new SDK for their scripts and automation's.
2527

28+
### Hybrid Runner Enhancements (Collate)
29+
30+
Improved setup speed and streamlined permissions management across teams while maintaining enterprise scalability and robustness. These changes make it easier to navigate organizational processes and departmental permission structures for data teams when setting up the Hybrid Infrastructure.
31+
32+
We’re also bringing out improvements on the Ingestion Runners UI, helping end users identify versions for both runner’s server and ingestion configurations. The rest of the UX will be the same for end users.
33+
2634
### Drive Support
2735

28-
- Files Spreadsheet
36+
{% youtube videoId="qokZSF0eUkM" start="0:00" end="02:17" width="800px" height="450px" /%}
37+
38+
- Google Drive Service UI (Collate) - Added UI support for Google Drive integration, with a generalized architecture to support other sources in the future (e.g., SharePoint or FTP).
39+
- These new services will help capture organic tribal knowledge locked in files, starting with obtaining data out of spreadsheets and worksheets.
2940

3041
### Enhanced SSO Setup & Configuration
3142

43+
{% youtube videoId="wO8ta1WgYRo" start="0:00" end="01:18" width="800px" height="450px" /%}
44+
3245
**Independent SSO Configuration**: Customer admins can now configure Google and Azure SSO directly from the OpenMetadata UI, removing the dependency on DevOps teams for manual setup.
3346

3447
**SSO Mapping Updates**: Improved mapping flexibility to streamline SSO setup and customization.
@@ -37,6 +50,8 @@ The existing Python SDK is still going to be internally used for the Ingestion F
3750

3851
### Data Contract UI Improvements
3952

53+
{% youtube videoId="H4z6exr45X4" start="0:00" end="02:08" width="800px" height="450px" /%}
54+
4055
**Unified Contract Format**: Data contracts now follow a redesigned layout modeled after a legal contract style, making them more structured and easier to interpret.
4156

4257
**New Contract Components**: Three new sections have been added to support richer agreements:
@@ -51,7 +66,16 @@ The existing Python SDK is still going to be internally used for the Ingestion F
5166

5267
### Connectors!
5368

54-
- TimescaleDB
69+
OpenMetadata and Collate keep expanding their connector ecosystem:
70+
71+
OpenMetadata:
72+
73+
- **TimescaleDB**: A time-series database for high-performance real-time analytics packages as a Postgres extension.
74+
75+
Collate:
76+
77+
- **ServiceNow**: As a new Database Service to extract your core metadata.
78+
- **Snowplow**: As a Pipeline Service for bringing in your customer behavior management workflows.
5579

5680
## Breaking Changes
5781

@@ -225,9 +249,10 @@ You can now remove the `print_status()` call. Note that the only side effect wou
225249
### Improvements
226250

227251
- Add custom measurement units field (pounds, decibels, etc.) for user-defined metrics
228-
- Add entityStatus field for different data assets
252+
- Introduced new field **entityStatus** for different dataAssets.
229253
- Add reviewers to tag, classification, dataProduct, metrics, and knowledge center pages
230254
- Add Spark Engine documentation
255+
- You can now test the connection for your Spark runner configuration
231256
- Allow admins to set default persona for all users
232257
- Add Contract Execution Chart Summary Card
233258
- Enhance sample data and resolve warnings
@@ -238,42 +263,44 @@ You can now remove the `print_status()` call. Note that the only side effect wou
238263
- Update rule for dataAssetRule and semantic form contract
239264
- Enable Bedrock embedding service
240265
- Update data contract details fields
241-
- Add Google Sheet connector
242-
- Add lineage support for Exasol connector
266+
- Added Google Sheet connector
267+
- Added lineage support for Exasol connector
243268
- Enable Elasticsearch search for databases
244-
- Add None value filter for Elasticsearch
269+
- Added None value filter for Elasticsearch
245270
- Improve Service Insights with live updates and bug fixes
246-
- Add Traditional Chinese translation
247-
- Add app widgets in OSS
248-
- Add comprehensive GitHub Copilot instructions
271+
- Added Traditional Chinese translation
272+
- Added app widgets in OSS
273+
- Added comprehensive GitHub Copilot instructions
249274
- Refactor BigQuery client type hinting
250-
- Add multi-domain breaking changes documentation
275+
- Added multi-domain breaking changes documentation
251276
- Update documentation for metadata/types API
252277
- Enhance sample data with owner and descriptions
253-
- Add PowerBI parse expression along with measure
278+
- Added PowerBI parse expression along with measure
254279
- Update data-retention documentation to include activityThreadsRetentionPeriod
255280
- Update documentation for 1.9.0 release
256281
- Update sync-doc workflow
257282
- Improve bulk import by disabling upload dragger when file is processing
258283
- Improve keyboard delete action in bulk actions
259284
- Remove lastLoginTime from change description
260-
- Add Spark UI support
261-
- Add OpenAPI YAML format support for REST API ingestion
285+
- Added Spark UI support
286+
- Added OpenAPI YAML format support for REST API ingestion
262287
- Update SECURITY.md to remove support for version 1.6.x
263288
- Update alerts documentation to include Advanced Configurations
264289
- Improve PowerBI table naming by preceding source table name
265-
- Add lineage table support
266-
- Add RDF Ontology, Json LD, DCAT vocabulary support
267-
- Add Sankey to ChartType enum
268-
- Add Tableau entity mapping documentation
269-
- Add comprehensive documentation for entity field update limitations in Python SDK
270-
- Add Row Count to Custom SQL Test
271-
- Add healthcheck on System Resource
272-
- Add deploy pipeline method to ingestion pipeline repository
290+
- Added lineage table support
291+
- Added RDF Ontology, Json LD, DCAT vocabulary support
292+
- Added Sankey to ChartType enum
293+
- Added Tableau entity mapping documentation
294+
- Added comprehensive documentation for entity field update limitations in Python SDK
295+
- Added Row Count to Custom SQL Test
296+
- Added healthcheck on System Resource
297+
- Added deploy pipeline method to ingestion pipeline repository
298+
- Incidents can now be filtered by domain
299+
- Pass / Failed row count is now available for Custom SQL Query
273300
- Improve overall performance
274301
- Refactor and enhance entity name transformation logic
275302
- Update asset types in curated assets list
276-
- Add missing domain migrations for entity version history
303+
- Added missing domain migrations for entity version history
277304
- Refactor DatabaseServiceTablesProcessor and simplify getLatestTableProfile logic
278305
- Improve Data Contract features
279306
- Improve Snowflake Tags Ingestion
@@ -282,153 +309,153 @@ You can now remove the `print_status()` call. Note that the only side effect wou
282309
- Use .nvmrc in GitHub workflows
283310
- Improve knowledge and Glossary/Term page redirect notification link
284311
- Expose retry_codes parameter in Airflow lineage backend configuration
285-
- Add order_by to Airflow ingest get_pipelines_list
312+
- Added order_by to Airflow ingest get_pipelines_list
286313
- Improve Unity Catalog lineage exception handling
287314
- Enable sub-domain access with hasDomain() Rule
288315
- Improve tag_usage performance
289-
- Add SAP HANA calculated view columns formula parsing logic
316+
- Added SAP HANA calculated view columns formula parsing logic
290317
- Open external links in new tab
291-
- Add queryUsage and other fields for bulk query fetching
292-
- Add specific endpoint for log downloads in streaming
293-
- Add backend validations on entity types for Data Contracts
318+
- Added queryUsage and other fields for bulk query fetching
319+
- Added specific endpoint for log downloads in streaming
320+
- Added backend validations on entity types for Data Contracts
294321
- Simplify migration context computing
295322
- Update translations across languages
296-
- Add JavaScript and CSS in non-filtered extension in pom file
323+
- Added JavaScript and CSS in non-filtered extension in pom file
297324
- Move migrations to version 1.9.5
298-
- Add rules per entity endpoint
325+
- Added rules per entity endpoint
299326
- Cleanup unused components
300327
- Improve Automator by separating terms and tags in action config
301328
- Mask Wherescape MSSQL Password
302329
- Refactor auth setup to avoid unnecessary logout and login operations
303-
- Add List import to avoid errors
304-
- Add Russian Language Support for Elasticsearch Search
330+
- Added List import to avoid errors
331+
- Added Russian Language Support for Elasticsearch Search
305332
- Update response code for docs and signin page
306333
- Allow additional fields for custom connectors
307334
- Pass additional_client_config_arguments to OpenMetadata correctly
308-
- Add Domain Independent Data Product Rule
335+
- Added Domain Independent Data Product Rule
309336
- Improve persona deletion and relations fetch handling
310-
- Add support for clone queries in BigQuery
337+
- Added support for clone queries in BigQuery
311338
- Improve data insight index for multidomain
312339
- Optimize login page load performance
313340
- Remove Spark connector support from UI
314-
- Add GlossaryTerm Search endpoint
315-
- Add support for sources key metadata fetch in dbt
316-
- Add ServiceNow Connector
317-
- Add Snowplow Connector
341+
- Added GlossaryTerm Search endpoint
342+
- Added support for sources key metadata fetch in dbt
343+
- Added ServiceNow Connector
344+
- Added Snowplow Connector
318345
- Enable transient table ingestion by default for Snowflake
319346
- Rename migration files from v195 to v196
320-
- Add Unstructured Formats Support to GCS Storage Connector
321-
- Add support for add/edit semantic rules
347+
- Added Unstructured Formats Support to GCS Storage Connector
348+
- Added support for add/edit semantic rules
322349
- Document ChangeEventScheduler and Race Condition status
323-
- Add SSL support to Hive
350+
- Added SSL support to Hive
324351
- Update API proxy path
325352
- Improve lineage with multiprocessing, stored procedure temp table processing and filtering
326-
- Add status and reviewers implementation for assets
327-
- Add new WorkflowType and converter
328-
- Add Security, SLA and Terms of Use to Data Contract
353+
- Added status and reviewers implementation for assets
354+
- Added new WorkflowType and converter
355+
- Added Security, SLA and Terms of Use to Data Contract
329356
- Allow alerts to notify lineage downstream entities stakeholders
330357
- Refactor Profiler for Metadata Extraction Application
331358
- Allow multi-asset selection for curated assets
332359
- Change contract update from PUT to PATCH
333-
- Add redirect to persona page when clicked on default persona
360+
- Added redirect to persona page when clicked on default persona
334361
- Restrict column selection to first level in nested columns for DataContract
335-
- Add entityType.keyword field with lowercase normalizer for case-insensitive search
336-
- Add App Runner to Application Entity
337-
- Add chart handling for Data Contract with schema validations
362+
- Added entityType.keyword field with lowercase normalizer for case-insensitive search
363+
- Added App Runner to Application Entity
364+
- Added chart handling for Data Contract with schema validations
338365
- Update contract security schema
339-
- Add custom operator support for array object contains
366+
- Added custom operator support for array object contains
340367
- Drop Insights Indexes
341-
- Add Postgres lineage dialect to Greenplum
342-
- Add cardinality metric for string and enum types
368+
- Added Postgres lineage dialect to Greenplum
369+
- Added cardinality metric for string and enum types
343370
- Increase max server threads
344-
- Add cardinality data distribution chart
345-
- Add dbt project name display
346-
- Add support for DBX Exporter
371+
- Added cardinality data distribution chart
372+
- Added dbt project name display
373+
- Added support for DBX Exporter
347374
- Extend application configuration component
348-
- Add theme setup functionality
375+
- Added theme setup functionality
349376
- Implement Custom Metrics Measurement Units
350-
- Add domain icon and drop-down for multiple domain names
377+
- Added domain icon and drop-down for multiple domain names
351378
- Remove embeddings for table index
352379
- Improve searching via MCP Client
353-
- Add Security and SLA tab support in data contract
354-
- Add TypeScript and ESLint checks on dev server
355-
- Add owner operation support with editOwner and editAll for teams
356-
- Add Unity Catalog data diff module using DBX connection
357-
- Add S3 logging from ingestion pipelines
380+
- Added Security and SLA tab support in data contract
381+
- Added TypeScript and ESLint checks on dev server
382+
- Added owner operation support with editOwner and editAll for teams
383+
- Added Unity Catalog data diff module using DBX connection
384+
- Added S3 logging from ingestion pipelines
358385
- Improve Russian translation dictionary
359386
- Rename contract consumers and improve data display on UI
360-
- Add MF4 File Reader
361-
- Add recognizer in classification
362-
- Add executedQuery field
387+
- Added MF4 File Reader
388+
- Added recognizer in classification
389+
- Added executedQuery field
363390
- Update contract SLA section list icon
364-
- Add reviewers to Metrics
391+
- Added reviewers to Metrics
365392
- Update impact analysis styles
366393
- Optimize mapFields caching in JSONLogicSearchClassBase
367-
- Add timezone and column name fields support in SLA form
368-
- Add ML model lineage support
369-
- Add ignore entities option for Data Product rule
370-
- Add support for SQL Server hierarchyid, geography, and geometry types
371-
- Add Domain, Sub-domain, and Data Product listing
394+
- Added timezone and column name fields support in SLA form
395+
- Added ML model lineage support
396+
- Added ignore entities option for Data Product rule
397+
- Added support for SQL Server hierarchyid, geography, and geometry types
398+
- Added Domain, Sub-domain, and Data Product listing
372399
- Improve test connection functionality
373400
- Improve Datalake column subfields handling
374401
- Improve advanced search field value suggestions
375402
- Move popover FQN to classbase for extension
376-
- Add no record found message for card view
403+
- Added no record found message for card view
377404
- Improve async search and tree lazy loading
378-
- Add Timescale Connector
405+
- Added Timescale Connector
379406
- Improve handling of columns not found or permission issues
380-
- Add logging endpoint to S3
407+
- Added logging endpoint to S3
381408
- Extend ENTITY_TYPE with additional entity types and fields
382-
- Add encryption for sensitive data in Exporter app
409+
- Added encryption for sensitive data in Exporter app
383410
- Change passed/failed rows to Long type for 64-bit numbers
384411
- Migrate build tool from terser to esbuild
385-
- Add NotificationTemplate CRUD operations
412+
- Added NotificationTemplate CRUD operations
386413
- Revamp persona section in user profile dropdown
387414
- Update lineage workflow configuration documentation
388-
- Add entityStatus and reviewers to testCase and testSuite
415+
- Added entityStatus and reviewers to testCase and testSuite
389416
- Improve data asset header layout and component styling
390-
- Add color and iconURL support in glossary import/export
417+
- Added color and iconURL support in glossary import/export
391418
- Fix duplicate ViewAll migration in OrganizationPolicy
392419
- Improve dbt debug logs
393-
- Add Metabase API Key authentication support
420+
- Added Metabase API Key authentication support
394421
- Ensure domain policy evaluation during PolicyEvaluator
395-
- Add impact analysis support for lineage
422+
- Added impact analysis support for lineage
396423
- Show entityStatus by default after migration
397424
- Implement zero-downtime reindex
398425
- Enable log streaming for ingestion pipelines
399-
- Add entityType.keyword aggregation in searchSettings.json
426+
- Added entityType.keyword aggregation in searchSettings.json
400427
- Improve Airflow DAG import error identification in CI
401-
- Add scroll support in certification popover list
428+
- Added scroll support in certification popover list
402429
- Improve timestamp sorting logic in IngestionRecentRuns component
403-
- Add created_by and created_at info display in UI for DataContract
430+
- Added created_by and created_at info display in UI for DataContract
404431
- Update contract security form details
405432
- Improve contract security initial data selection
406433
- Cleanup orphaned data contracts
407-
- Add not_contains support in contract semantic form
408-
- Add threat model and incident response documentation
434+
- Added not_contains support in contract semantic form
435+
- Added threat model and incident response documentation
409436
- Improve Drive service with bug fixes
410-
- Add OM Operation to remove security config
411-
- Add field level validation in SSO configuration
437+
- Added OM Operation to remove security config
438+
- Added field level validation in SSO configuration
412439
- Improve ContractExecutionChart to occupy full space with left-aligned bars
413-
- Add option to opt out of BigQuery Policy Tags Ingestion
440+
- Added option to opt out of BigQuery Policy Tags Ingestion
414441
- Implement Modern Fluent API Pattern for OpenMetadata Java Client
415442
- Update platform info banner logic
416-
- Add notify downstream functionality with related UI
417-
- Add support for Tags customizable rules with feedback capture
418-
- Add running status support in contract execution chart
419-
- Add entity column list support in contract security form
443+
- Added notify downstream functionality with related UI
444+
- Added support for Tags customizable rules with feedback capture
445+
- Added running status support in contract execution chart
446+
- Added entity column list support in contract security form
420447
- Improve SSO with field level error handling
421-
- Add notification template validation and reset
422-
- Add data products widget
448+
- Added notification template validation and reset
449+
- Added data products widget
423450
- Update required Node.js version to 22 in prerequisites
424-
- Add notification for default persona change
451+
- Added notification for default persona change
425452
- Improve avatar initial display
426-
- Add route position support for plugin routes
427-
- Add SSO configuration UI and SCIM bot token management with Group Mapping
453+
- Added route position support for plugin routes
454+
- Added SSO configuration UI and SCIM bot token management with Group Mapping
428455
- Improve Kafka Connect lineage and descriptions
429456
- Sort data in total data assets widget by count
430-
- Add createdBy and createdAt for data contracts
431-
- Add support for Stored Procedures and Functions in MariaDB
457+
- Added createdBy and createdAt for data contracts
458+
- Added support for Stored Procedures and Functions in MariaDB
432459
- Skip orphaned pipelines in Secret migrations
433460
- Revamp data contract UI and functionality
434461
- Allow team creation on child when creating on parent team

0 commit comments

Comments
 (0)