Add Pinterest link extraction and URL mutation support#208
Conversation
- Add url_mutations to Pinterest API scheme to convert profile URLs to API URLs - Add links field to Pinterest API scheme (extracts website_url) - Add links field to Pinterest profile/board page scheme (extracts domain_url) - Add e2e test for Pinterest account using example URL Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com> Agent-Logs-Url: https://github.com/soxoj/socid-extractor/sessions/57850dc1-78b2-4472-b512-5a9c6bb47a3e
|
@copilot why you haven't implemented the link check "info['links'] == "['https://plus.google.com..."? |
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com> Agent-Logs-Url: https://github.com/soxoj/socid-extractor/sessions/0b016edc-7158-457d-a6ef-057b8b269740
Added the specific link assertion in |
|
@copilot test_buzzfeed failed, figure out why |
Co-authored-by: soxoj <31013580+soxoj@users.noreply.github.com> Agent-Logs-Url: https://github.com/soxoj/socid-extractor/sessions/adba0512-954f-4f80-ab48-6be6427daf1e
The Marked it as Warning Firewall rules blocked me from connecting to one or more addresses (expand for details)I tried to connect to the following addresses, but was blocked by firewall rules:
If you need me to access, download, or install something from one of these locations, you can either:
|
Pinterest profiles expose external links (e.g. Google Plus URLs) but the extractor didn't capture them. Additionally, there was no URL mutation to convert profile URLs into API endpoints.
Changes
url_mutationsonPinterest APIscheme — convertspinterest.{tld}/{username}URLs to the internalUserResourceAPI endpoint, enabling extraction from profile URLs directlylinksfield on both Pinterest schemes — extractswebsite_url(API) /domain_url(profile page) as a list, consistent with other schemes'linksfieldshttps://www.pinterest.com/melgaspar666/viamutate_url→parse→extractflowExample
Warning
Firewall rules blocked me from connecting to one or more addresses (expand for details)
I tried to connect to the following addresses, but was blocked by firewall rules:
www.pinterest.com/usr/bin/python3 python3 -c from socid_extractor.main import parse, extract result = parse('REDACTED') print('Pages returned:', len(result)) if result: page = result[0] print('Page length:', len(page)) print('First 2000 chars:', page[:2000(dns block)If you need me to access, download, or install something from one of these locations, you can either:
Original prompt
⚡ Quickly spin up Copilot coding agent tasks from anywhere on your macOS or Windows machine with Raycast.