Skip to content

Releases: DataKitchen/dataops-testgen

3.7.3

31 Mar 20:49

Choose a tag to compare

Bug Fixes

  • Connection "http_path" was missing (f19741a)
  • profiling: replace null characters before copy command (2f52a15)

Docker Image

datakitchen/dataops-testgen:v3.7.3

PyPI Package

dataops-testgen==3.7.3

3.7.1

25 Mar 05:42

Choose a tag to compare

Features

  • flavors: Adding support to Databricks (e08e964)
  • scoring: keep history of score results for each score definition (8455400)
  • scoring: display score card history as line charts (20072a4)
  • data-catalog: add autocomplete for tags (dd5d58f)
  • data-catalog: add tree filters (e506fa7)
  • data-catalog: add data preview dialog (c913595)
  • data-catalog: add multi-edit mode (1f03c7f)
  • update user roles (d26a111)
  • roles: apply permissions to results disposition (0334101)
  • roles: apply permissions to data catalog (0b763c9)
  • telemetry: Sending event when user logs in (498778f)

Bug Fixes

  • scoring: add missing filter to scoring view (0d53ef8)
  • scoring: issues and inconsistencies storing history (6d68465)
  • data-catalog: shows tags inherited from table group (fbdfb74)
  • data-catalog: add new http-path to data preview query (4ea4aa8)
  • roles: apply permissions to empty state actions (db60ef6)
  • roles: apply permissions to canceling runs (6516a9c)
  • roles: apply missing permissions to connections, table groups & scores (f5ae33c)
  • scores: bugs in saving to db (0e24a16)
  • data catalog: bugs in tree (412d547)
  • bugs in routing (d589ae4)
  • Upgrade PyArrow at the base image (bf85763)
  • connections: hide Test Connection button for non-admins (b79b7ba)
  • project in query param not sticking on refresh (019bfe6)

Refactors

  • consolidate user session service, remove auth service (8f80b5c)
  • imports in test results (b892972)
  • project-settings: improve edit form (8d288d2)
  • sidebar: improve layout, add App Logs button (888424d)
  • cleanup dead code (ee2d850)

Miscellaneous

  • db: function decorator to manage database sessions (504f162)
  • scoring: add views and table for score recalc (0d68ee9)
  • scoring: implement score recalculation (0a26d6e)
  • ui: add line chart component (66ac23a)

Docker Image

datakitchen/dataops-testgen:v3.7.1

PyPI Package

dataops-testgen==3.7.1

testgen-0.1.1

07 Mar 02:18
c8dd8dc

Choose a tag to compare

A Helm chart for Kubernetes

3.1.2

06 Mar 17:41

Choose a tag to compare

Bug Fixes

  • scores: key error on empty state (b3b4f35)
  • ui: bug in run timestamp displays (0edf526)
  • runs: old profiling runs incorrectly marked as error (d01f27e)
  • runs: update Running runs to Canceled on startup (4e54943)

Refactors

  • runs: simplify code to update run status (a467372)

Docker Image

datakitchen/dataops-testgen:v3.1.2

PyPI Package

dataops-testgen==3.1.2

3.1.0

28 Feb 07:05

Choose a tag to compare

Features

  • Adding Helm charts (caae9e6)
  • helm-charts: support extra volume and mounts, update secret (0b1f403)

Bug Fixes

  • docker: empty version env var in image (09d571e)
  • scores: hide empty scorecards and make breakdown filter conditional (82efe24)

Docker Image

datakitchen/dataops-testgen:v3.1.0

PyPI Package

dataops-testgen==3.1.0

testgen-services-0.1.0

28 Feb 05:16
d4d1ce1

Choose a tag to compare

A Helm chart for Kubernetes

testgen-0.1.0

28 Feb 05:16
d4d1ce1

Choose a tag to compare

A Helm chart for Kubernetes

3.0.0

19 Feb 16:49

Choose a tag to compare

Features

  • scoring: display scoring for each table group in the overview page (fa05577)
  • ui: add sections to nav bar (09c80a5)
  • scoring: refresh data characteristics during test execution (acbe3e7)
  • scoring: add new score dashboard (fe5e36a)
  • scoring: add details page for score cards (c36ce70)
  • ui: display scores in Data Catalog, Profiling Runs & Test Runs (1ab9794)
  • test-suites: add "exclude from scoring" checkbox to add/edit dialog (2ddffcb)
  • components: improvements to button, checkbox and paginator (7f080fd)
  • score-issues: add pagination, multi-selection and issue reports in score drilldown (e178d13)
  • quality-dashboard: add profiling and testing scores to cards (3cc7ef8)
  • scores: support refreshing scores for runs and table groups (cd81a82)
  • scores: add score refresh buttons in hygiene issues and test results pages (ad79073)
  • data-catalog: consolidate, rename & improve tags (12eb738)
  • scoring: add support for custom score cards (92a6813)
  • scoring: refresh score cards results (4db34fb)
  • scoring: register a scorecard on table group creation (1b8c372)
  • ui: add component for column profiling results (afec021)
  • scoring: add column profiling to issues (938afa5)
  • project-dashboard: add sort by lowest score (1faa4a9)
  • cdes: add checkbox to table group for flagging cdes (a688763)
  • profiling: display bar for alpha case distribution (2b1d3b3)
  • Copy or Move test definitions TG-826 (0ba7fee)
  • sidebar: display project name above nav menu (3bf9612)
  • score-issues: add filters (6cf5e4d)
  • data-catalog: support drag to resize tree (aca99fa)

Bug Fixes

  • security: Switch the base image to Alpine to fix vulnerabilities (f95d10a)
  • functions: Eliminating the need of a trailing space on function calls (66d5408)
  • overview: minor fixes and styling improvements (491e6ed)
  • sql: special characters in pattern match test (3a15652)
  • overview: set default value for pandas null (00d267a)
  • overview: apply sort on first render (65d1766)
  • build: Pinning the matplotlib version (752b62f)
  • ui: use mutation observer to sync height (cc2a904)
  • test suites: add missing elements (320ac51)
  • ui: update highlight for client-side Selects (714d614)
  • test suites: dynamically display empty state (83f3136)
  • scoring: fixes + query and styling updates (8ddc483)
  • scoring: query fixes and styling updates (5a58672)
  • table groups: prevent unintentional edit to Explicit Table List (8de1510)
  • sql: bugs in data characteristics refresh and score dashboard queries (c3d6c4f)
  • sql: broken score details (da2d04a)
  • ui: make score cards compatible with dark mode (65e7fd5)
  • ui: display fixes for scoring, test suites and dashboard pages (32a8d4a)
  • project: handle project code in score queries (e05f974)
  • quality-dashboard: bugs in search (adce378)
  • profiling-results: broken function reference and missing filters (96449b4)
  • scoring: add missing labels and other suggestions (f61145a)
  • scoring: remove dq_dimension as a explorer filter (272cfc1)
  • scoring: rearrange the breadcrumbs in score explorer (987d43f)
  • scoring: minor css and text updates (008e197)
  • scoring: issues binding to query params (7a45396)
  • scoring: aggregate issues count for impact calc (d2d7a61)
  • broken link and incorrect date display on dashboard (4c363fd)
  • scoring: bug in latest_profile_record_ct (aa878d3)
  • router: exclude none query params when navigating (66d6ea3)
  • sql: bugs in upgrade script and test score calc (c48c2e9)
  • score-explorer: error on saving empty filter + responsive css (5c235c0)
  • sql: updates to impact calc (0fbc403)
  • data-chars: skip record count retrieval if no tables (5439b35)
  • scoring: reduce number of reruns in the explorer (03c8832)
  • scoring: update record count subquery (7723412)
  • scoring: load related objects for score definition (529b784)
  • scoring: send empty score card when no filters applied (e3313d0)
  • scoring: block saving of empty score cards (1ac2ab0)
  • scoring: initial display of empty card (9bae26e)
  • scoring: render initial state of score details in the explorer (02c808a)
  • upgrade: grant executor role rights to new scoring tables (c4d75ef)
  • test-execution: separate prevalence calc to prevent errors from affecting run (b458201)
  • column-profiling: align summary and percent bars (223fbba)
  • data-catalog: bug in editing tags (f0c02a5)
  • data-catalog: tweaks to column distribution, tooltips for tags (fe1ec09)
  • test-definitions: dropped tables and columns not displayed in filters (d9f8984)
  • test-validation: table tests for dropped tables not deactivated (4e1536c)
  • copy-tests: update to profiling and manual date fields (4a666f6)

Refactors

  • convert overview page to vanjs component (d0669a1)
  • ui: rename data hierarchy to data catalog (4a7e2b0)
  • forms: downgrade pydantic version for pypi release (1b968f5)
  • test suites: move page logic to vanjs (1c98c0e)
  • ui: support logo plugin (9c85f6b)
  • ui: rename "overview" and "score dashboard" pages (5cbcade)
  • scoring: split score details into components (e88dd94)
  • scores: make score displays consistent (6167060)
  • scoring: move queries to sqlalchemy model methods (0f48fb9)
  • scoring: enable cde score in score cards (0994dba)
  • components: add border property to Card (5e8ba8c)
  • data-catalog: make characteristics, distribution and issues cards reusable (5de4ac6)
  • data-catalog: make queries reusable and consistent (69ddd3e)
  • ui: replace column profiling with new component (ac46ffa)
  • remove dead code (f65acbc)
  • navigation: queue the navigation when receiving linkclicked event (36cb4d3)
  • tooltip-icon: add Icon component and use withTooltip (25a91d3)

Miscellaneous

  • functions: Code review feedback (93b2038)
  • add default ports to add connection form (6f68fa8)
  • ui: add empty state vanjs component (1b2d04e)
  • ui: add caption and metric reusable component (bc9e9dd)
  • ui: make some vanjs components more customizable (7060365)
  • Code review feedback (ed26f8d)
  • connections: change default max query chars (9e2a609)
  • pin scipy version (75aca92)
  • ui: update wording in score details page (2217061)
  • scores: add empty state message for score dashboard (43774ae)
  • scores: update styles and text (c709643)
  • linting: adress linting suggestions (e1d8b2f)
  • scoring: add new data_product column (bdf3ab2)
  • ui: remove cache clear when switching between scoring pages (b4386fc)
  • scoring: cache score card breakdown items (78d889f)
  • scoring: clear score list cache on delete and create (bab63a1)
  • scoring: display loading spinners (f025c0a)
  • components: support tooltips in input and attribute (45d8819)
  • scoring: uncomment score type dropdown in breakdown table (1c872ea)

Docker Image

datakitchen/dataops-testgen:v3.0.0

PyPI Package

dataops-testgen==3.0.0

2.24.8

03 Dec 04:03

Choose a tag to compare

Bug Fixes

  • connection: bug in changing sql flavor (d056635)

Docker Image

datakitchen/dataops-testgen:v2.24.8

PyPI Package

dataops-testgen==2.24.8

2.24.7

27 Nov 03:11

Choose a tag to compare

Features

  • pdf: Test Result PDF report (dea50a0)
  • ui: add empty_state widget (15b3941)
  • ui: add empty state messaging and links/actions to all top-level pages (5c1de82)
  • pdf: Improving the PDF report aesthetics (330aca1)
  • pdf: Refacoring the code and fixing the header (77f107e)
  • ui: bind grid selection to query parameters (7555216)
  • overview: add sort dropdown for table groups list (716ff8a)
  • overview: add input field to filter table groups list (fd076da)
  • connections: use the new wizard for setting up table groups (493d4c3)
  • ui: add a database flavor selector component (4d11dc1)
  • pdf: Hygiene Issues report (66ca55d)
  • link: support opening links in new tabs (eee533c)
  • components: add BoxPlot, PercentBar and FrequencyBars components (58ca5a7)
  • components: add Attribute, Card and EditableCard components (6f1f595)
  • components: add Input, Checkbox and RadioGroup components (b8cb63a)
  • components: add Tree component (d87f69c)
  • components: add ColumnProfile component (fd343eb)
  • ui: add Data Hierarchy page (b1bf3ea)
  • cli: add scoring infrastructure and default score roll-ups (f5ba879)
  • ui: add community and training links to header (b8a94b3)
  • pdf: add link backs to pdf issue reports (8390a16)

Bug Fixes

  • ui: update empty state widget (0cf62ac)
  • ui: handle height of page components responsively (79c708f)
  • upgrade: add where clause in sql update statements with joins (7c1aa58)
  • pdf: Fixing the data table header aligment plus some other improvements (deaf648)
  • auth: handle cookies retrieved inconsistently (e3a1311)
  • misc: Download dialog code cleanup (close, progress) (a86be02)
  • ui: send the selection ID to AGgrid (eb3f71a)
  • overview: truncate tests percentage (8451e74)
  • overview: sort by latest activity date instead of dual sorting (69d490b)
  • ui: Add streamlit-pydantic to list of dependencies (25ac0f5)
  • python 3.10 compatibility and missing import (9ee6bd2)
  • connections: use the flavor form when parsing validation errors (3b84e6a)
  • connections: display cached value for private key file uploader (a6e20a7)
  • ui: use index instead of value in flavor selector (372c12b)
  • sleep to protect against multiple reruns (1a167b8)
  • profiling: add parenthesis to profiling issue criteria (10c612e)
  • threshold error count fix: code fixes (fc6cb63)
  • threshold error count (1113bcd)
  • profiling: add parenthesis to the formatted anomaly criteria (776d2b3)
  • ui: Adding database icons to the python built package (b9b1743)
  • ui: add table and column filters to hygiene issues and test results (bd32353)
  • ui: add dk favicon to image (6116f3b)
  • ui: error on login screen (5be063c)
  • runs: increase sleep before closing run dialogs (9c2848e)
  • ui: deep-linking on test results page (7d78958)
  • ui: update bind query js syntax (6593ddf)
  • profiling: TG-774 - disable profiling dialog for multi-table results. (726bd9a)
  • functions: Strip out comments when loading templated functions (fca069b)
  • ui: bug fixes on test results and connection wizard (973bb4a)
  • pdf: make file names unique when zipping multiple (a4729ef)
  • ui: bug in format duration utility (da6e23a)
  • data-hierarchy: add selected query param to test issue link (c690125)
  • sql: bug in source data dialog (524218e)
  • ui: deep links intermittently don't work (926b8a1)
  • overview: error when profiling date exists but no test date (fbaa6be)
  • sql: special characters in pattern match test (374a5d5)

Refactors

  • ui: rename "toolbar_select" widget to generic "select" (bed5d1c)
  • dialogs: move execution dialogs to separate files (2048bba)
  • ui: improvements to vanjs components to support page components (f8e26f3)
  • ui: use page components in test runs and profiling runs (dc968b5)
  • ui: improve and abstract event handling from page components (0d749e9)
  • components: upgrade vanJS to latest version (a67078b)
  • tooltip: support tooltip positions - add to button and tooltip-icon components (41b25c1)

Miscellaneous

  • ui: enhancements to button, link and flex widgets (764bd12)
  • ui: disable buttons when not relevant and styling improvements (40b24e9)
  • ui: add db flavor icons for azure sql and synapse (5e0ec9a)
  • profiling: remove qc schema creation logic (e64d20a)
  • summary: add legend colors to summary bar component (ab08ba2)
  • ui: improve data hierarchy query performance (9fa43f1)
  • ui: improve query performance with new fields (7b51a95)
  • change level of repetitive docker check log (666b447)

Docker Image

datakitchen/dataops-testgen:v2.24.7