Chrome extension dont load correctly on scrapy-playwright

[Jaogmar]

I was trying to use extension with scrapy playwright, the extension is loaded to chrome process correctly but when i do a request the extension dont be activate tho this context/window like the extension is disabled

this is the PLAYWRIGHT_LAUNCH_OPTIONS that i used

custom_settings = {
        "PLAYWRIGHT_LAUNCH_OPTIONS": {
            "headless": False,
            "args": [
                "--disable-blink-features=AutomationControlled",
                "--disable-infobars",
                "--no-sandbox",
                "--disable-setuid-sandbox",
                "--load-extension=/path/to/extension",
                "--disable-extensions-except=/path/to/extension",
            ],
    }

And this is the result of what i was saying

the chrome context that is showing the extension icon is the context that was manually opened by the context behind

[elacuesta]

The upstream docs on Chrome extensions mention that they only work with persistent context, so you'll need to launch yours accordingly.

This is what I tried, from what I see the extension loaded correctly as it appears in the extensions menu:

import tempfile
import scrapy

path_to_extension = "/.../Downloads/dist-chrome-2025.7.1/"

class ExtensionSpider(scrapy.Spider):
    name = "extension"
    custom_settings = {
        "TWISTED_REACTOR": "twisted.internet.asyncioreactor.AsyncioSelectorReactor",
        "DOWNLOAD_HANDLERS": {
            "https": "scrapy_playwright.handler.ScrapyPlaywrightDownloadHandler",
        },
        "PLAYWRIGHT_CONTEXTS": {
            "persistent": {
                "user_data_dir": tempfile.mkdtemp(),
                "args": [
                    f"--disable-extensions-except={path_to_extension}",
                    f"--load-extension={path_to_extension}",
                ],
                "slow_mo": 10_000,
                "headless": False,
            }
        },
    }

    def start_requests(self):
        yield scrapy.Request(
            url="https://books.toscrape.com",
            meta={"playwright": True, "playwright_context": "persistent"},
        )

    def parse(self, response):
        print("Page title:", response.css("title::text").get().strip())

Regarding configuration, I'd assume that would depend on the specific extension. I'm not really familiar with Chrome extensions and I don't know how to interact with them programmatically, the only reference I can provide is once again from the upstream docs (also quoting myself from a previous comment in a related ticket): if you need access to the context before the navigation is performed you could use playwright_page_init_callback, something like

async def init_page(page, request):
    context = page.context
    if len(context.background_pages) == 0:
        background_page = await context.wait_for_event('backgroundpage')
    else:
        background_page = context.background_pages[0]