-
Notifications
You must be signed in to change notification settings - Fork 69
Closed
Description
dlt version
1.9.0
Describe the problem
I am running the hubspot source to write to a filesystem in parquet format.
many of the properties in the tables are numbers,
I would expect them to give me numeric results, but instead all numbers are saved as string/varchar
for example:
companies
:recent_deal_Amount
- is a number property in hubspot
curl --location 'https://api.hubapi.com/crm/v3/properties/companies'
{
"updatedAt": "2024-12-19T18:54:33.881Z",
"createdAt": "2020-06-30T15:57:37.521Z",
"name": "recent_deal_amount",
"label": "Recent Deal Amount",
"type": "number",
"fieldType": "number",
"description": "Amount of last closed won deal associated with this company. Set automatically.",
"groupName": "deal_information",
...
}
but is saved as a varchar in my table
Expected behavior
Fields which are numbers in Hubspot are inferred as numeric in dlt
Steps to reproduce
ToDo
Operating system
macOS
Runtime environment
Local
Python version
3.12
dlt data source
hubspot
dlt destination
Filesystem & buckets
Other deployment details
No response
Additional information
I think part of it is becuase the hubspot API returns all properties as strings
Metadata
Metadata
Assignees
Labels
No labels
Type
Projects
Status
Ready for Deployment
Status
Done