TC358743 HDMI to CSI-2 #184

hugomon · 2022-01-07T18:57:44Z

hugomon
Jan 7, 2022

I have been successfully testing a TC358743 HDMI to CSI-2 on a Raspberry Pi Zero 2 W with the latest RaspiOS distribution and Hyperion.ng installed on it. The only problem detected was one core at 100% constantly.
Doing the same process with HyperHDR, it detects the unicam as a usb grabber but doesn't seem to activate it (no image is seen and it doesn't block it).
Does anyone have any idea why it doesn't work?

awawa-dev · 2022-01-07T19:25:38Z

awawa-dev
Jan 7, 2022
Maintainer

Hi
HyperHDR's logs could provide more information what's happening during the device initialization.

Please upload them to service like pastebin and provide us link (first 2-3 minutes of HyperHDR work after start)

Are you using latest Raspberry Pi OS image (32 or 64?) with HyperHDR v17? I don't think it's possible for v17 due to core libraries changes in Raspbian distribution (buster -> bullseye).

0 replies

hugomon · 2022-01-07T20:00:29Z

hugomon
Jan 7, 2022
Author

I will try to upload the log tomorrow.
It was the Raspios bullseye arm64 version.

0 replies

awawa-dev · 2022-01-07T20:04:26Z

awawa-dev
Jan 7, 2022
Maintainer

Ok. I recommend to use v18beta (ready installers for bullseye are available in the latest 'action' tab) because v17 was released for buster which is still supported by the Raspberry Pi OS.

0 replies

hugomon · 2022-01-08T17:04:34Z

hugomon
Jan 8, 2022
Author

Installed last version HyperHDR-18.0.0.0beta1-bullseye-Linux-aarch64.deb, still not woking.

This is the debug log:

Debug log

2022-01-08T16:55:29.708Z [MAIN] Database path: '/home/pi/.hyperhdr/db/hyperhdr.db', readonlyMode = disabled
2022-01-08T16:55:29.709Z [MAIN] Starting HyperHdr - 18.0.0.0beta1, (HEAD detached at 91f12c1) (Awawa-8649b99/91f12c1-1640905382), built: Dec 30 2021:23:48:20
2022-01-08T16:55:29.709Z [MAIN] Set user data path to '/home/pi/.hyperhdr'
2022-01-08T16:55:29.716Z [DB] Database opened: /home/pi/.hyperhdr/db/hyperhdr.db
2022-01-08T16:55:29.810Z [SETTINGSMGR] Settings database initialized
2022-01-08T16:55:29.812Z [HYPERHDR] Sound device is disabled
2022-01-08T16:55:29.845Z [V4L2:UNICAM-IMAGE (] Cropping image: width=0 height=0; crop: left=0 right=0 top=0 bottom=0
2022-01-08T16:55:29.846Z [V4L2:UNICAM-IMAGE (] Found capture device: /dev/video15
2022-01-08T16:55:29.847Z [V4L2:UNICAM-IMAGE (] Found capture device: /dev/video14
2022-01-08T16:55:29.848Z [V4L2:UNICAM-IMAGE (] Found capture device: /dev/video0
2022-01-08T16:55:29.850Z [V4L2:UNICAM-IMAGE (] Restarting video grabber is now blocked due to reloading of the configuration
2022-01-08T16:55:29.850Z [V4L2:UNICAM-IMAGE (] Cropping image: width=0 height=0; crop: left=0 right=0 top=0 bottom=0
2022-01-08T16:55:29.850Z [V4L2:unicam-image (] (GrabberWrapper.cpp:45) CEC keycode. Start: 0, stop: 0
2022-01-08T16:55:29.851Z [V4L2:UNICAM-IMAGE (] (Grabber.cpp:231) setBrightnessContrastSaturationHue nothing changed
2022-01-08T16:55:29.851Z [V4L2:UNICAM-IMAGE (] (V4L2Grabber.cpp:98) setHdrToneMappingMode to: Disabled
2022-01-08T16:55:29.851Z [V4L2:UNICAM-IMAGE (] (Grabber.cpp:140) setFpsSoftwareDecimation to: 1
2022-01-08T16:55:29.851Z [SIGNAL_OLD] (DetectionManual.cpp:85) Signal detection area set to: 0.250000,0.250000 x 0.750000,0.750000
2022-01-08T16:55:29.851Z [SIGNAL_OLD] (DetectionManual.cpp:75) Signal threshold set to: {0, 0, 0} and frames: 50
2022-01-08T16:55:29.851Z [SIGNAL_AUTO] (DetectionAutomatic.cpp:367) Automatic signal detection -> errorTolerance: 9, modelTolerance: 90, sleepTime: 1000, wakeTime: 0
2022-01-08T16:55:29.852Z [V4L2:UNICAM-IMAGE (] (Grabber.cpp:336) setDeviceVideoStandard preparing to restart video grabber. Old: '' new: 'unicam-image (video0)'
2022-01-08T16:55:29.852Z [V4L2:UNICAM-IMAGE (] Delayed restart of the grabber due to change of selected device
2022-01-08T16:55:29.852Z [V4L2:UNICAM-IMAGE (] (Grabber.cpp:158) Force encoding to: NO_CHANGE (old: NO_CHANGE)
2022-01-08T16:55:29.852Z [V4L2:UNICAM-IMAGE (] setQFrameDecimation is now: disabled
2022-01-08T16:55:29.852Z [V4L2:unicam-image (] (GrabberWrapper.cpp:525) Frame cache is: enabled
2022-01-08T16:55:29.854Z [X11_SYSTEM:AUTO] Cropping image: width=0 height=0; crop: left=0 right=0 top=0 bottom=0
2022-01-08T16:55:29.855Z [X11_SYSTEM:AUTO] Loaded X11 proxy library for screen capturing
2022-01-08T16:55:29.855Z [X11_SYSTEM:AUTO] Restarting video grabber is now blocked due to reloading of the configuration
2022-01-08T16:55:29.855Z [X11_SYSTEM:AUTO] (Grabber.cpp:117) Set new width: 512, height: 512 for capture
2022-01-08T16:55:29.855Z [X11_SYSTEM:AUTO] (Grabber.cpp:291) setWidthHeight preparing to restarting video grabber 0
2022-01-08T16:55:29.855Z [X11_SYSTEM:AUTO] Delayed restart of the grabber due to change of the capturing resolution
2022-01-08T16:55:29.856Z [X11_SYSTEM:AUTO] Delayed restart of the grabber due to change of the framerate
2022-01-08T16:55:29.856Z [SIGNAL_OLD] (DetectionManual.cpp:85) Signal detection area set to: 0.250000,0.250000 x 0.750000,0.750000
2022-01-08T16:55:29.856Z [SIGNAL_OLD] (DetectionManual.cpp:75) Signal threshold set to: {12, 12, 12} and frames: 200
2022-01-08T16:55:29.856Z [X11_SYSTEM:AUTO] (Grabber.cpp:336) setDeviceVideoStandard preparing to restart video grabber. Old: '' new: 'auto'
2022-01-08T16:55:29.856Z [X11_SYSTEM:AUTO] Delayed restart of the grabber due to change of selected device
2022-01-08T16:55:29.909Z [SETTINGSMGR] Settings database initialized
2022-01-08T16:55:29.914Z [BLACKBORDER] Set mode to: default
2022-01-08T16:55:29.915Z [COMPONENTREG0] Blackborder detector: enabled
2022-01-08T16:55:29.915Z [IMAGETOLED0] (ImageProcessor.cpp:153) set user led mapping to advanced
2022-01-08T16:55:29.916Z [IMAGETOLED0] (ImageProcessor.cpp:136) setSparseProcessing to 0
2022-01-08T16:55:29.918Z [RGB_TRANSFORM0] RGB transform classic_config: 1, saturationGain: 1.000000, luminanceGain: 1.000000, backlightThreshold: 1
2022-01-08T16:55:29.918Z [RGB_TRANSFORM0] setBacklightThreshold: 1
2022-01-08T16:55:29.918Z [ADJUST_RED0] Set correction to 255
2022-01-08T16:55:29.918Z [ADJUST_BLUE0] Set correction to 255
2022-01-08T16:55:29.918Z [ADJUST_GREEN0] Set correction to 255
2022-01-08T16:55:29.936Z [JSONSERVER] (JsonServer.cpp:28) Created instance
2022-01-08T16:55:29.937Z [JSONSERVER] Started on port 19444
2022-01-08T16:55:29.924Z [DB] Database opened: /home/pi/.hyperhdr/db/hyperhdr.db
2022-01-08T16:55:29.945Z [LEDDEVICE_wled] Start LedDevice 'wled'.
2022-01-08T16:55:29.946Z [SMOOTHING0] Clearing queued colors before: enabling
2022-01-08T16:55:29.946Z [COMPONENTREG0] Smoothing: enabled
2022-01-08T16:55:29.946Z [SMOOTHING0] Creating config (0) => type: Alternative, dirMode: false, pause: false, settlingTime: 50ms, interval: 50ms (20Hz), antiFlickTres: 0, antiFlickStep: 0, antiFlickTime: 0
2022-01-08T16:55:29.946Z [SMOOTHING0] Clearing queued colors before: enabling. Smoothing configuration changed: restarting timer.
2022-01-08T16:55:29.946Z [SMOOTHING0] Selecting config (0) => type: Alternative, dirMode: false, pause: false, settlingTime: 50ms, interval: 50ms (20Hz), antiFlickTres: 0, antiFlickStep: 0, antiFlickTime: 0
2022-01-08T16:55:29.946Z [SMOOTHING0] Selecting config (0) => type: Alternative, dirMode: false, pause: false, settlingTime: 50ms, interval: 50ms (20Hz), antiFlickTres: 0, antiFlickStep: 0, antiFlickTime: 0
2022-01-08T16:55:29.946Z [LEDDEVICE_wled] (LedDeviceWled.cpp:55)
2022-01-08T16:55:29.948Z [LEDDEVICE_wled] (LedDevice.cpp:171) deviceConfig: [{"colorOrder":"rgb","currentLedCount":118,"hardwareLedCount":118,"host":"192.168.88.108","latchTime":0,"refreshTime":0,"type":"wled"}]
2022-01-08T16:55:29.948Z [LEDDEVICE_wled] (LedDevice.cpp:194) Stopping timer
2022-01-08T16:55:29.948Z [LEDDEVICE_wled] (LedDevice.cpp:445) RefreshTime updated to 0ms
2022-01-08T16:55:29.948Z [LEDDEVICE_wled] (LedDeviceWled.cpp:63) DeviceType : wled
2022-01-08T16:55:29.948Z [LEDDEVICE_wled] (LedDeviceWled.cpp:64) LedCount : 118
2022-01-08T16:55:29.949Z [LEDDEVICE_wled] (LedDeviceWled.cpp:65) ColorOrder : rgb
2022-01-08T16:55:29.949Z [LEDDEVICE_wled] (LedDeviceWled.cpp:107)
2022-01-08T16:55:29.950Z [FLATBUFCONN] Connecting to HyperHDR: 127.0.0.1:19401
2022-01-08T16:55:29.951Z [LEDDEVICE_wled] (LedDeviceWled.cpp:118) [1]
2022-01-08T16:55:29.952Z [LEDDEVICE_wled] (LedDevice.cpp:171) deviceConfig: [{"colorOrder":"rgb","currentLedCount":118,"hardwareLedCount":118,"host":"192.168.88.108","latchTime":0,"port":19446,"refreshTime":0,"type":"wled"}]
2022-01-08T16:55:29.953Z [LEDDEVICE_wled] (LedDevice.cpp:194) Stopping timer
2022-01-08T16:55:29.953Z [LEDDEVICE_wled] (LedDevice.cpp:445) RefreshTime updated to 0ms
2022-01-08T16:55:29.954Z [MUXER0] Register new input 'System/VIDEOGRABBER' with priority 240 as inactive
2022-01-08T16:55:29.954Z [LEDDEVICE_wled] (ProviderUdp.cpp:42) Successfully parsed 192.168.88.108 as an IP-address.
2022-01-08T16:55:29.954Z [COMPONENTREG0] Video capture device: enabled
2022-01-08T16:55:29.974Z [V4L2:UNICAM-IMAGE (] Multithreading for V4L2 is enabled. Available thread's count 4
2022-01-08T16:55:29.976Z [V4L2:UNICAM-IMAGE (] Found capture device: /dev/video15
2022-01-08T16:55:29.978Z [V4L2:UNICAM-IMAGE (] Found capture device: /dev/video14
2022-01-08T16:55:29.979Z [V4L2:UNICAM-IMAGE (] Found capture device: /dev/video0
2022-01-08T16:55:29.982Z [V4L2:UNICAM-IMAGE (] (V4L2Grabber.cpp:185) Searching for unicam-image (video0) 0 x 0 @ 0 fps, input: -1 (NO_CHANGE)
2022-01-08T16:55:29.983Z [V4L2:UNICAM-IMAGE (] Could not find any capture device settings
2022-01-08T16:55:29.954Z [LEDDEVICE_wled] (ProviderUdp.cpp:72) UDP socket will write to 192.168.88.108:19446
2022-01-08T16:55:29.954Z [LEDDEVICE_wled] (LedDeviceWled.cpp:96) Hostname/IP : 192.168.88.108
2022-01-08T16:55:29.955Z [LEDDEVICE_wled] (LedDeviceWled.cpp:97) Port : 19446
2022-01-08T16:55:29.955Z [LEDDEVICE_wled] (LedDeviceWled.cpp:101) [1]
2022-01-08T16:55:29.956Z [BOBLIGHT] Instance created
2022-01-08T16:55:29.984Z [HYPERMANAGER] HyperHDR instance 'Dell U3011' has been started
2022-01-08T16:55:29.985Z [DAEMON] Unload CEC
2022-01-08T16:55:29.956Z [LEDDEVICE_wled] (LedDeviceWled.cpp:130)
2022-01-08T16:55:29.957Z [LEDDEVICE] (ProviderRestApi.cpp:152) PUT: [http://192.168.88.108/json/state] [{"on":true,"live":true}]
2022-01-08T16:55:29.969Z [WEBSERVER] Initialize Webserver
2022-01-08T16:55:29.971Z [WEBSERVER] Initialize Webserver
2022-01-08T16:55:29.994Z [SMOOTHING0] Using alternative smoothing procedure (0)
2022-01-08T16:55:30.012Z [WEBSERVER] Apply Webserver settings
2022-01-08T16:55:30.012Z [WEBSERVER] Apply Webserver settings
2022-01-08T16:55:30.012Z [WEBSERVER] Set document root to: :/webconfig
2022-01-08T16:55:30.012Z [WEBSERVER] Set document root to: :/webconfig
2022-01-08T16:55:30.014Z [WEBSERVER] Started on port 8090 name 'HyperHDR Webserver'
2022-01-08T16:55:30.021Z [WEBSERVER] Setup SSL certificate
2022-01-08T16:55:30.022Z [WEBSERVER] Setup private SSL key
2022-01-08T16:55:30.023Z [WEBSERVER] Started on port 8092 name 'HyperHDR Webserver'
2022-01-08T16:55:30.194Z [MUXER0] Switching from color effect. Waiting till: 16:55:33
2022-01-08T16:55:30.281Z [LEDDEVICE] (ProviderRestApi.cpp:191) Reply.httpStatusCode [200]
2022-01-08T16:55:30.282Z [COMPONENTREG0] LED device: enabled
2022-01-08T16:55:30.283Z [EFFECTENGINE0] Run effect "Rainbow swirl fast" on channel 0
2022-01-08T16:55:30.284Z [EFFECTENGINE0] (EffectEngine.cpp:152) Start the effect: name [Rainbow swirl fast], smoothCfg [2]
2022-01-08T16:55:30.284Z [MUXER0] Register new input 'System/EFFECT' with priority 0 as inactive
2022-01-08T16:55:30.284Z [HYPERHDR] Initial foreground effect 'Rainbow swirl fast' started
2022-01-08T16:55:30.285Z [SMOOTHING0] Using alternative smoothing input (0)
2022-01-08T16:55:30.287Z [EFFECT0(Rainbo...)] Begin playing the effect with priority: 0
2022-01-08T16:55:30.289Z [MUXER0] Priority 0 is now active
2022-01-08T16:55:30.290Z [MUXER0] Set visible priority to 0
2022-01-08T16:55:30.290Z [IMAGETOLED0] Total index number is: 424. Sparse processing: disabled, image size: 80 x 45, area number: 118
2022-01-08T16:55:30.291Z [IMAGETOLED0] Total index number is: 424. Sparse processing: disabled, image size: 80 x 45, area number: 118
2022-01-08T16:55:30.291Z [SMOOTHING0] Clearing queued colors before: enabling. Smoothing configuration changed: restarting timer.
2022-01-08T16:55:30.291Z [SMOOTHING0] Selecting config (2) => type: Linear, dirMode: false, pause: false, settlingTime: 200ms, interval: 40ms (25Hz), antiFlickTres: 0, antiFlickStep: 0, antiFlickTime: 0
2022-01-08T16:55:30.291Z [SMOOTHING0] Using linear smoothing input (2)
2022-01-08T16:55:30.292Z [HYPERHDR0] New priority[0], previous [255]
2022-01-08T16:55:30.292Z [HYPERHDR0] New source available -> switch LED-Device on
2022-01-08T16:55:30.292Z [SMOOTHING0] Clearing queued colors before: enabling
2022-01-08T16:55:30.293Z [IMAGETOLED0] (ImageProcessor.cpp:180) set hard led mapping to multicolor_mean
2022-01-08T16:55:30.293Z [SMOOTHING0] Using linear smoothing input (2)
2022-01-08T16:55:30.333Z [SMOOTHING0] Using linear smoothing procedure (2)
2022-01-08T16:55:33.289Z [EFFECT0(Rainbo...)] The effect quits with priority: 0
2022-01-08T16:55:33.290Z [MUXER0] Removed source priority 0
2022-01-08T16:55:33.290Z [MUXER0] Set visible priority to 255
2022-01-08T16:55:33.290Z [SMOOTHING0] Clearing queued colors before: enabling. Smoothing configuration changed: restarting timer.
2022-01-08T16:55:33.290Z [SMOOTHING0] Selecting config (0) => type: Alternative, dirMode: false, pause: false, settlingTime: 50ms, interval: 50ms (20Hz), antiFlickTres: 0, antiFlickStep: 0, antiFlickTime: 0
2022-01-08T16:55:33.290Z [SMOOTHING0] Using alternative smoothing input (0)
2022-01-08T16:55:33.291Z [HYPERHDR0] New priority[255], previous [0]
2022-01-08T16:55:33.291Z [HYPERHDR0] No source left -> switch LED-Device off
2022-01-08T16:55:33.291Z [SMOOTHING0] Clearing queued colors before: disabling
2022-01-08T16:55:33.291Z [LEDDEVICE_wled] (LedDeviceWled.cpp:148)
2022-01-08T16:55:33.292Z [LEDDEVICE] (ProviderRestApi.cpp:152) PUT: [http://192.168.88.108/json/state] [{"on":false,"live":false}]
2022-01-08T16:55:33.292Z [IMAGETOLED0] (ImageProcessor.cpp:180) set hard led mapping to multicolor_mean
2022-01-08T16:55:33.294Z [IMAGETOLED0] Total index number is: 424. Sparse processing: disabled, image size: 80 x 45, area number: 118
2022-01-08T16:55:33.294Z [EFFECTENGINE0] Effect 'Rainbow swirl fast' has finished.
2022-01-08T16:55:33.295Z [EFFECT0(Rainbo...)] Deleting effect named: 'Rainbow swirl fast'
2022-01-08T16:55:33.587Z [LEDDEVICE] (ProviderRestApi.cpp:191) Reply.httpStatusCode [200]
2022-01-08T16:55:34.155Z [WEBSOCKET] (WebSocketClient.cpp:30) New connection from ::ffff:192.168.88.235
2022-01-08T16:55:34.156Z [WEBSOCKET] (JsonAPI.cpp:89) Client '::ffff:192.168.88.235' switch to HyperHDR instance 0
2022-01-08T16:55:34.319Z [DB] Database opened: /home/pi/.hyperhdr/db/hyperhdr.db
2022-01-08T16:55:34.657Z [WEBSOCKET] (JsonAPI.cpp:1348) log streaming activated for client ::ffff:192.168.88.235

Those lines look relevant:

2022-01-08T16:55:29.982Z [V4L2:UNICAM-IMAGE (] (V4L2Grabber.cpp:185) Searching for unicam-image (video0) 0 x 0 @ 0 fps, input: -1 (NO_CHANGE)
2022-01-08T16:55:29.983Z [V4L2:UNICAM-IMAGE (] Could not find any capture device settings

2 replies

awawa-dev Jan 8, 2022
Maintainer

Exactly, no valid resolutions for capturing were found. Try to run v4l2-ctl --list-formats-ext in the command line.

awawa-dev Jan 8, 2022
Maintainer

BTW did you provide HDMI signal to the device when HyperHDR was starting? Because some devices behave like that when no HDMI source is available for capturing.

hugomon · 2022-01-08T17:32:27Z

hugomon
Jan 8, 2022
Author

Yes, it has an Nvidia Shield connected at 1080p50, the maximum that the grabber supports using UYVY, with this configuration it can be used in Hyperion.ng.

pi@raspberrypi:~ $ v4l2-ctl --list-formats-ext
ioctl: VIDIOC_ENUM_FMT
        Type: Video Capture

        [0]: 'RGB3' (24-bit RGB 8-8-8)
        [1]: 'UYVY' (UYVY 4:2:2)

1 reply

hugomon Jan 8, 2022
Author

v4l2-ctl -V
Format Video Capture:
        Width/Height      : 1920/1080
        Pixel Format      : 'UYVY' (UYVY 4:2:2)
        Field             : None
        Bytes per Line    : 3840
        Size Image        : 4147200
        Colorspace        : SMPTE 170M
        Transfer Function : Default (maps to Rec. 709)
        YCbCr/HSV Encoding: Default (maps to ITU-R 601)
        Quantization      : Default (maps to Limited Range)
        Flags             :

awawa-dev · 2022-01-08T19:15:41Z

awawa-dev
Jan 8, 2022
Maintainer

OK, I know what happens: RGB3 format was never supported, UYVY format was removed quite long ago because very little devices use it and you are the first user who complains about it ;) Technically RGB3 is superior compare to UYVY, but offers a bit worse performance for HDR tone mapping. I can re-implement UYVY again, but since I don't have such device are you willing to test it and provide feedback if it works?

0 replies

Uh oh!

TC358743 HDMI to CSI-2 #184

Uh oh!

hugomon Jan 7, 2022

Replies: 6 comments · 3 replies

Uh oh!

Uh oh!

awawa-dev Jan 7, 2022 Maintainer

Uh oh!

hugomon Jan 7, 2022 Author

Uh oh!

awawa-dev Jan 7, 2022 Maintainer

Uh oh!

hugomon Jan 8, 2022 Author

Uh oh!

awawa-dev Jan 8, 2022 Maintainer

Uh oh!

Uh oh!

awawa-dev Jan 8, 2022 Maintainer

Uh oh!

hugomon Jan 8, 2022 Author

Uh oh!

Uh oh!

hugomon Jan 8, 2022 Author

Uh oh!

awawa-dev Jan 8, 2022 Maintainer

hugomon
Jan 7, 2022

Replies: 6 comments 3 replies

awawa-dev
Jan 7, 2022
Maintainer

hugomon
Jan 7, 2022
Author

awawa-dev
Jan 7, 2022
Maintainer

hugomon
Jan 8, 2022
Author

awawa-dev Jan 8, 2022
Maintainer

awawa-dev Jan 8, 2022
Maintainer

hugomon
Jan 8, 2022
Author

hugomon Jan 8, 2022
Author

awawa-dev
Jan 8, 2022
Maintainer