Error in `k4aviewer`: "Depth engine create and initialize failed,retCode:204" after initial setup

[christiandreher]

Describe the bug

I tried to build the K4A wrapper from source on my Ubuntu 22 machine and tried to start a Femto Bolt with k4aviewer. I can see the device in k4aviewer, and I can open it, but it doesn't show any images or similar. In fact, only IMU data seems to work. The log reads repeatedly:

[01/03 20:26:45.369042][info][2919144][MSDEConverterDevice.cpp:67] Depth engine got nvram data size:490872
[01/03 20:26:45.369055][info][2919144][MSDEConverterDevice.cpp:94] use dynlib load depthengine lib......
GlContext::Initialize eglMakeCurrent error code = 0x3000
[01/03 20:26:45.427319][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204
[2025-01-03 20:26:45.427] [error] [t=2919144] /code/armar7/deps/orbbec_sdk_v2/k4a_wrapper/src/orbbec/ob_type_helper.cpp (47): orbbec_sdk_log(). [01/03 20:26:45.427319][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204

This seems to be a common issue with Depth engine again... However, I cannot resolve it.

Out of curiosity, I then tried to replace libdepthengine.so.2.0 with another version from Microsoft from v1.4.1. With this version, the errors at least do not show, but the depth image and also the IR image look completely distorted:

The same camera works fine when using OrbbecViewer.

To Reproduce

1. Build project from source as described in readmes etc. on Ubuntu 22.04
2. Open k4aviewer
3. Open a Femto Bolt device
4. Press start

Expected behavior
I expect the Femto Bolt to work when following the install guides etc. as it does with OrbbecViewer.

Logs

[▽ armar7]  chris@i61spc013  /code/armar7/deps  orbbec_k4aviewer   
[01/03 20:26:31.655340][info][2919092][Context.cpp:68] Context created with config: default config!
[01/03 20:26:31.655386][info][2919092][Context.cpp:73] Work directory=/code/armar7/deps/orbbec_sdk_v2/k4a_wrapper/build/install/bin, SDK version=v1.10.11-20240724-aeaa107
[01/03 20:26:31.655445][info][2919092][LinuxPal.cpp:32] createObPal: create LinuxPal!
[01/03 20:26:31.752377][info][2919092][LinuxPal.cpp:143] Create PollingDeviceWatcher!
[01/03 20:26:31.752464][info][2919092][DeviceManager.cpp:15] Current found device(s): (1)
[01/03 20:26:31.752491][info][2919092][DeviceManager.cpp:24] 	- Name: Femto Bolt, PID: 0x066b, SN/ID: CL8C84F0008, Connection: USB3.1
[01/03 20:26:31.752788][info][2919092][Context.cpp:84] Context destroyed
[01/03 20:26:31.753175][info][2919092][Context.cpp:68] Context created with config: default config!
[01/03 20:26:31.753203][info][2919092][Context.cpp:73] Work directory=/code/armar7/deps/orbbec_sdk_v2/k4a_wrapper/build/install/bin, SDK version=v1.10.11-20240724-aeaa107
[01/03 20:26:31.753242][info][2919092][LinuxPal.cpp:32] createObPal: create LinuxPal!
[01/03 20:26:31.756432][info][2919092][LinuxPal.cpp:143] Create PollingDeviceWatcher!
[01/03 20:26:31.756502][info][2919092][DeviceManager.cpp:15] Current found device(s): (1)
[01/03 20:26:31.756537][info][2919092][DeviceManager.cpp:24] 	- Name: Femto Bolt, PID: 0x066b, SN/ID: CL8C84F0008, Connection: USB3.1
[01/03 20:26:31.756760][info][2919092][Context.cpp:84] Context destroyed
[01/03 20:26:33.383167][info][2919092][Context.cpp:68] Context created with config: default config!
[01/03 20:26:33.383198][info][2919092][Context.cpp:73] Work directory=/code/armar7/deps/orbbec_sdk_v2/k4a_wrapper/build/install/bin, SDK version=v1.10.11-20240724-aeaa107
[01/03 20:26:33.383239][info][2919092][LinuxPal.cpp:32] createObPal: create LinuxPal!
[01/03 20:26:33.386451][info][2919092][LinuxPal.cpp:143] Create PollingDeviceWatcher!
[01/03 20:26:33.386523][info][2919092][DeviceManager.cpp:15] Current found device(s): (1)
[01/03 20:26:33.386542][info][2919092][DeviceManager.cpp:24] 	- Name: Femto Bolt, PID: 0x066b, SN/ID: CL8C84F0008, Connection: USB3.1
[01/03 20:26:33.386670][info][2919092][FemtoBoltUvcDevice.cpp:23] FemtoBoltUvcDevice init ...
[01/03 20:26:33.386832][info][2919092][FemtoBoltUvcDevice.cpp:121] Create command start!
[01/03 20:26:33.387597][info][2919092][MSDEConverterDevice.cpp:726] Succeed to load depth engine plugin
[01/03 20:26:34.712334][info][2919092][AbstractDevice.cpp:121] 	- Firmware version: 1.0.9
[01/03 20:26:34.712363][info][2919092][FemtoBoltUvcDevice.cpp:280] Create command done!
[01/03 20:26:34.712382][info][2919092][FemtoBoltUvcDevice.cpp:401] init sensor map start!
[01/03 20:26:34.712425][info][2919092][FemtoBoltUvcDevice.cpp:428] init sensor map done!
[01/03 20:26:34.712588][info][2919092][FemtoBoltUvcDevice.cpp:284] Init depth process param start!
[01/03 20:26:35.058624][info][2919092][MSDEConverterDevice.cpp:777] got nvram data succeed.
[01/03 20:26:35.323020][info][2919092][FemtoBoltUvcDevice.cpp:358] setNvramDataStreamStopFunc succeed
[01/03 20:26:35.323097][info][2919092][FemtoBoltUvcDevice.cpp:397] Init depth process param done!
[01/03 20:26:37.203945][info][2919092][FemtoBoltUvcDevice.cpp:38] FemtoBoltUvcDevice init done!
[01/03 20:26:37.203998][info][2919092][DeviceManager.cpp:150] Device created successfully! Name: Femto Bolt, PID: 0x066b, SN/ID: CL8C84F0008
[01/03 20:26:37.204078][info][2919092][Pipeline.cpp:47] Pipeline created with device: {name: Femto Bolt, sn: CL8C84F0008}, @0x55CC18E67460
[01/03 20:26:37.207589][info][2919092][Pipeline.cpp:708] config is nullptr,return default calibration param!
[01/03 20:26:37.209319][info][2919092][FemtoBoltUvcDevice.cpp:573] Color sensor has been created!
[01/03 20:26:45.145829][info][2919092][FemtoBoltUvcDevice.cpp:528] Depth sensor has been created!
[01/03 20:26:45.145958][info][2919092][VideoSensor.cpp:384] Query stream profile! size= 14, SensorType=OB_SENSOR_DEPTH
[01/03 20:26:45.145984][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_DEPTH, format: OB_FORMAT_Y16, width: 640, height: 576, fps: 15}
[01/03 20:26:45.146000][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_DEPTH, format: OB_FORMAT_Y16, width: 1024, height: 1024, fps: 15}
[01/03 20:26:45.146014][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_DEPTH, format: OB_FORMAT_Y16, width: 1024, height: 1024, fps: 5}
[01/03 20:26:45.146028][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_DEPTH, format: OB_FORMAT_Y16, width: 640, height: 576, fps: 30}
[01/03 20:26:45.146052][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_DEPTH, format: OB_FORMAT_Y16, width: 320, height: 288, fps: 30}
[01/03 20:26:45.146066][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_DEPTH, format: OB_FORMAT_Y16, width: 640, height: 576, fps: 25}
[01/03 20:26:45.146079][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_DEPTH, format: OB_FORMAT_Y16, width: 320, height: 288, fps: 25}
[01/03 20:26:45.146093][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_DEPTH, format: OB_FORMAT_Y16, width: 320, height: 288, fps: 15}
[01/03 20:26:45.146106][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_DEPTH, format: OB_FORMAT_Y16, width: 640, height: 576, fps: 5}
[01/03 20:26:45.146120][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_DEPTH, format: OB_FORMAT_Y16, width: 320, height: 288, fps: 5}
[01/03 20:26:45.146133][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_DEPTH, format: OB_FORMAT_Y16, width: 512, height: 512, fps: 30}
[01/03 20:26:45.146147][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_DEPTH, format: OB_FORMAT_Y16, width: 512, height: 512, fps: 25}
[01/03 20:26:45.146160][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_DEPTH, format: OB_FORMAT_Y16, width: 512, height: 512, fps: 15}
[01/03 20:26:45.146174][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_DEPTH, format: OB_FORMAT_Y16, width: 512, height: 512, fps: 5}
[01/03 20:26:45.146329][info][2919092][FemtoBoltUvcDevice.cpp:617] Ir sensor has been created!
[01/03 20:26:45.146419][info][2919092][VideoSensor.cpp:384] Query stream profile! size= 14, SensorType=OB_SENSOR_IR
[01/03 20:26:45.146448][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_IR, format: OB_FORMAT_Y16, width: 640, height: 576, fps: 15}
[01/03 20:26:45.146463][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_IR, format: OB_FORMAT_Y16, width: 1024, height: 1024, fps: 15}
[01/03 20:26:45.146485][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_IR, format: OB_FORMAT_Y16, width: 1024, height: 1024, fps: 5}
[01/03 20:26:45.146515][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_IR, format: OB_FORMAT_Y16, width: 640, height: 576, fps: 30}
[01/03 20:26:45.146535][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_IR, format: OB_FORMAT_Y16, width: 320, height: 288, fps: 30}
[01/03 20:26:45.146551][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_IR, format: OB_FORMAT_Y16, width: 640, height: 576, fps: 25}
[01/03 20:26:45.146565][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_IR, format: OB_FORMAT_Y16, width: 320, height: 288, fps: 25}
[01/03 20:26:45.146578][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_IR, format: OB_FORMAT_Y16, width: 320, height: 288, fps: 15}
[01/03 20:26:45.146592][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_IR, format: OB_FORMAT_Y16, width: 640, height: 576, fps: 5}
[01/03 20:26:45.146605][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_IR, format: OB_FORMAT_Y16, width: 320, height: 288, fps: 5}
[01/03 20:26:45.146619][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_IR, format: OB_FORMAT_Y16, width: 512, height: 512, fps: 30}
[01/03 20:26:45.146638][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_IR, format: OB_FORMAT_Y16, width: 512, height: 512, fps: 25}
[01/03 20:26:45.146652][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_IR, format: OB_FORMAT_Y16, width: 512, height: 512, fps: 15}
[01/03 20:26:45.146665][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_IR, format: OB_FORMAT_Y16, width: 512, height: 512, fps: 5}
[01/03 20:26:45.147956][info][2919092][VideoSensor.cpp:384] Query stream profile! size= 84, SensorType=OB_SENSOR_COLOR
[01/03 20:26:45.147975][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 1920, height: 1080, fps: 15}
[01/03 20:26:45.147990][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_YUYV, width: 1280, height: 720, fps: 30}
[01/03 20:26:45.148004][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_YUYV, width: 1280, height: 720, fps: 25}
[01/03 20:26:45.148017][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_YUYV, width: 1280, height: 720, fps: 15}
[01/03 20:26:45.148031][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_YUYV, width: 1280, height: 720, fps: 5}
[01/03 20:26:45.148044][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 1280, height: 720, fps: 30}
[01/03 20:26:45.148058][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 1280, height: 720, fps: 25}
[01/03 20:26:45.148071][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 1280, height: 720, fps: 15}
[01/03 20:26:45.148084][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 1280, height: 720, fps: 5}
[01/03 20:26:45.148098][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 1280, height: 960, fps: 30}
[01/03 20:26:45.148112][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 1280, height: 960, fps: 25}
[01/03 20:26:45.148126][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 1280, height: 960, fps: 15}
[01/03 20:26:45.148140][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 1280, height: 960, fps: 5}
[01/03 20:26:45.148154][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 1920, height: 1080, fps: 30}
[01/03 20:26:45.148167][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 1920, height: 1080, fps: 25}
[01/03 20:26:45.148181][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 1920, height: 1080, fps: 5}
[01/03 20:26:45.148194][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 2560, height: 1440, fps: 30}
[01/03 20:26:45.148208][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 2560, height: 1440, fps: 25}
[01/03 20:26:45.148221][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 2560, height: 1440, fps: 15}
[01/03 20:26:45.148235][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 2560, height: 1440, fps: 5}
[01/03 20:26:45.148249][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 3840, height: 2160, fps: 30}
[01/03 20:26:45.148262][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 3840, height: 2160, fps: 25}
[01/03 20:26:45.148282][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 3840, height: 2160, fps: 15}
[01/03 20:26:45.148296][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_MJPG, width: 3840, height: 2160, fps: 5}
[01/03 20:26:45.148311][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 1280, height: 720, fps: 30}
[01/03 20:26:45.148324][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 1280, height: 720, fps: 25}
[01/03 20:26:45.148338][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 1280, height: 720, fps: 15}
[01/03 20:26:45.148358][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 1280, height: 720, fps: 5}
[01/03 20:26:45.148378][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 1280, height: 960, fps: 30}
[01/03 20:26:45.148392][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 1280, height: 960, fps: 25}
[01/03 20:26:45.148406][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 1280, height: 960, fps: 15}
[01/03 20:26:45.148428][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 1280, height: 960, fps: 5}
[01/03 20:26:45.148443][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 1920, height: 1080, fps: 30}
[01/03 20:26:45.148456][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 1920, height: 1080, fps: 25}
[01/03 20:26:45.148470][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 1920, height: 1080, fps: 15}
[01/03 20:26:45.148483][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 1920, height: 1080, fps: 5}
[01/03 20:26:45.148497][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 2560, height: 1440, fps: 30}
[01/03 20:26:45.148510][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 2560, height: 1440, fps: 25}
[01/03 20:26:45.148525][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 2560, height: 1440, fps: 15}
[01/03 20:26:45.148538][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 2560, height: 1440, fps: 5}
[01/03 20:26:45.148552][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 3840, height: 2160, fps: 30}
[01/03 20:26:45.148565][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 3840, height: 2160, fps: 25}
[01/03 20:26:45.148579][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 3840, height: 2160, fps: 15}
[01/03 20:26:45.148592][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_RGB888, width: 3840, height: 2160, fps: 5}
[01/03 20:26:45.148606][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 1280, height: 720, fps: 30}
[01/03 20:26:45.148619][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 1280, height: 720, fps: 25}
[01/03 20:26:45.148633][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 1280, height: 720, fps: 15}
[01/03 20:26:45.148646][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 1280, height: 720, fps: 5}
[01/03 20:26:45.148660][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 1280, height: 960, fps: 30}
[01/03 20:26:45.148674][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 1280, height: 960, fps: 25}
[01/03 20:26:45.148691][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 1280, height: 960, fps: 15}
[01/03 20:26:45.148705][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 1280, height: 960, fps: 5}
[01/03 20:26:45.148719][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 1920, height: 1080, fps: 30}
[01/03 20:26:45.148733][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 1920, height: 1080, fps: 25}
[01/03 20:26:45.148746][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 1920, height: 1080, fps: 15}
[01/03 20:26:45.148760][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 1920, height: 1080, fps: 5}
[01/03 20:26:45.148774][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 2560, height: 1440, fps: 30}
[01/03 20:26:45.148787][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 2560, height: 1440, fps: 25}
[01/03 20:26:45.148800][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 2560, height: 1440, fps: 15}
[01/03 20:26:45.148814][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 2560, height: 1440, fps: 5}
[01/03 20:26:45.148827][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 3840, height: 2160, fps: 30}
[01/03 20:26:45.148842][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 3840, height: 2160, fps: 25}
[01/03 20:26:45.148855][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 3840, height: 2160, fps: 15}
[01/03 20:26:45.148869][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 3840, height: 2160, fps: 5}
[01/03 20:26:45.148883][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 1280, height: 720, fps: 30}
[01/03 20:26:45.148897][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 1280, height: 720, fps: 25}
[01/03 20:26:45.148910][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 1280, height: 720, fps: 15}
[01/03 20:26:45.148924][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 1280, height: 720, fps: 5}
[01/03 20:26:45.148938][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 1280, height: 960, fps: 30}
[01/03 20:26:45.148951][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 1280, height: 960, fps: 25}
[01/03 20:26:45.148965][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 1280, height: 960, fps: 15}
[01/03 20:26:45.148978][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 1280, height: 960, fps: 5}
[01/03 20:26:45.148992][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 1920, height: 1080, fps: 30}
[01/03 20:26:45.149005][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 1920, height: 1080, fps: 25}
[01/03 20:26:45.149019][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 1920, height: 1080, fps: 15}
[01/03 20:26:45.149033][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 1920, height: 1080, fps: 5}
[01/03 20:26:45.149046][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 2560, height: 1440, fps: 30}
[01/03 20:26:45.149071][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 2560, height: 1440, fps: 25}
[01/03 20:26:45.149085][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 2560, height: 1440, fps: 15}
[01/03 20:26:45.149098][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 2560, height: 1440, fps: 5}
[01/03 20:26:45.149112][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 3840, height: 2160, fps: 30}
[01/03 20:26:45.149125][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 3840, height: 2160, fps: 25}
[01/03 20:26:45.149139][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 3840, height: 2160, fps: 15}
[01/03 20:26:45.149152][info][2919092][VideoSensor.cpp:386]  - {type: OB_STREAM_COLOR, format: OB_FORMAT_NV12, width: 3840, height: 2160, fps: 5}
[01/03 20:26:45.149285][info][2919092][Pipeline.cpp:188] Check and set config start!
[01/03 20:26:45.149330][info][2919092][Pipeline.cpp:223] Check and set config done!
[01/03 20:26:45.149885][info][2919092][Pipeline.cpp:288] Try to start streams!
[01/03 20:26:45.149977][info][2919092][VideoSensor.cpp:646] start OB_SENSOR_DEPTH stream with profile: {type: OB_STREAM_DEPTH, format: OB_FORMAT_Y16, width: 640, height: 576, fps: 30}, Backend Format: OB_FORMAT_Y16
[01/03 20:26:45.149995][info][2919092][MSDEConverterDevice.cpp:549] Start real profile,width:7680 height:434
[01/03 20:26:45.151809][info][2919144][MSDEConverterDevice.cpp:67] Depth engine got nvram data size:490872
[01/03 20:26:45.151904][info][2919144][MSDEConverterDevice.cpp:94] use dynlib load depthengine lib......
GlContext::Initialize eglMakeCurrent error code = 0x3000
[01/03 20:26:45.251104][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204
[2025-01-03 20:26:45.251] [error] [t=2919144] /code/armar7/deps/orbbec_sdk_v2/k4a_wrapper/src/orbbec/ob_type_helper.cpp (47): orbbec_sdk_log(). [01/03 20:26:45.251104][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204

[01/03 20:26:45.251226][info][2919144][MSDEConverterDevice.cpp:67] Depth engine got nvram data size:490872
[01/03 20:26:45.251239][info][2919144][MSDEConverterDevice.cpp:94] use dynlib load depthengine lib......
GlContext::Initialize eglMakeCurrent error code = 0x3000
[01/03 20:26:45.310417][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204
[2025-01-03 20:26:45.310] [error] [t=2919144] /code/armar7/deps/orbbec_sdk_v2/k4a_wrapper/src/orbbec/ob_type_helper.cpp (47): orbbec_sdk_log(). [01/03 20:26:45.310417][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204

[01/03 20:26:45.310499][info][2919144][MSDEConverterDevice.cpp:67] Depth engine got nvram data size:490872
[01/03 20:26:45.310513][info][2919144][MSDEConverterDevice.cpp:94] use dynlib load depthengine lib......
GlContext::Initialize eglMakeCurrent error code = 0x3000
[01/03 20:26:45.368942][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204
[2025-01-03 20:26:45.368] [error] [t=2919144] /code/armar7/deps/orbbec_sdk_v2/k4a_wrapper/src/orbbec/ob_type_helper.cpp (47): orbbec_sdk_log(). [01/03 20:26:45.368942][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204

[01/03 20:26:45.369042][info][2919144][MSDEConverterDevice.cpp:67] Depth engine got nvram data size:490872
[01/03 20:26:45.369055][info][2919144][MSDEConverterDevice.cpp:94] use dynlib load depthengine lib......
GlContext::Initialize eglMakeCurrent error code = 0x3000
[01/03 20:26:45.427319][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204
[2025-01-03 20:26:45.427] [error] [t=2919144] /code/armar7/deps/orbbec_sdk_v2/k4a_wrapper/src/orbbec/ob_type_helper.cpp (47): orbbec_sdk_log(). [01/03 20:26:45.427319][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204

[01/03 20:26:45.427420][info][2919144][MSDEConverterDevice.cpp:67] Depth engine got nvram data size:490872
[01/03 20:26:45.427432][info][2919144][MSDEConverterDevice.cpp:94] use dynlib load depthengine lib......
GlContext::Initialize eglMakeCurrent error code = 0x3000
[01/03 20:26:45.485704][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204
[2025-01-03 20:26:45.485] [error] [t=2919144] /code/armar7/deps/orbbec_sdk_v2/k4a_wrapper/src/orbbec/ob_type_helper.cpp (47): orbbec_sdk_log(). [01/03 20:26:45.485704][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204

[01/03 20:26:45.485802][info][2919144][MSDEConverterDevice.cpp:67] Depth engine got nvram data size:490872
[01/03 20:26:45.485814][info][2919144][MSDEConverterDevice.cpp:94] use dynlib load depthengine lib......
GlContext::Initialize eglMakeCurrent error code = 0x3000
[01/03 20:26:45.544402][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204
[2025-01-03 20:26:45.544] [error] [t=2919144] /code/armar7/deps/orbbec_sdk_v2/k4a_wrapper/src/orbbec/ob_type_helper.cpp (47): orbbec_sdk_log(). [01/03 20:26:45.544402][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204

[01/03 20:26:45.544516][info][2919144][MSDEConverterDevice.cpp:67] Depth engine got nvram data size:490872
[01/03 20:26:45.544527][info][2919144][MSDEConverterDevice.cpp:94] use dynlib load depthengine lib......
GlContext::Initialize eglMakeCurrent error code = 0x3000
[01/03 20:26:45.602966][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204
[2025-01-03 20:26:45.603] [error] [t=2919144] /code/armar7/deps/orbbec_sdk_v2/k4a_wrapper/src/orbbec/ob_type_helper.cpp (47): orbbec_sdk_log(). [01/03 20:26:45.602966][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204

[01/03 20:26:45.603079][info][2919144][MSDEConverterDevice.cpp:67] Depth engine got nvram data size:490872
[01/03 20:26:45.603091][info][2919144][MSDEConverterDevice.cpp:94] use dynlib load depthengine lib......
GlContext::Initialize eglMakeCurrent error code = 0x3000
[01/03 20:26:45.661708][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204
[2025-01-03 20:26:45.661] [error] [t=2919144] /code/armar7/deps/orbbec_sdk_v2/k4a_wrapper/src/orbbec/ob_type_helper.cpp (47): orbbec_sdk_log(). [01/03 20:26:45.661708][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204

[01/03 20:26:45.661823][info][2919144][MSDEConverterDevice.cpp:67] Depth engine got nvram data size:490872
[01/03 20:26:45.661836][info][2919144][MSDEConverterDevice.cpp:94] use dynlib load depthengine lib......
GlContext::Initialize eglMakeCurrent error code = 0x3000
[01/03 20:26:45.720331][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204
[2025-01-03 20:26:45.720] [error] [t=2919144] /code/armar7/deps/orbbec_sdk_v2/k4a_wrapper/src/orbbec/ob_type_helper.cpp (47): orbbec_sdk_log(). [01/03 20:26:45.720331][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204

[01/03 20:26:45.720440][info][2919144][MSDEConverterDevice.cpp:67] Depth engine got nvram data size:490872
[01/03 20:26:45.720452][info][2919144][MSDEConverterDevice.cpp:94] use dynlib load depthengine lib......
GlContext::Initialize eglMakeCurrent error code = 0x3000
[01/03 20:26:45.778923][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204
[2025-01-03 20:26:45.778] [error] [t=2919144] /code/armar7/deps/orbbec_sdk_v2/k4a_wrapper/src/orbbec/ob_type_helper.cpp (47): orbbec_sdk_log(). [01/03 20:26:45.778923][error][2919144][MSDEConverterDevice.cpp:101] Depth engine create and initialize failed,retCode:204

[01/03 20:26:45.779371][info][2919092][VideoSensor.cpp:646] start OB_SENSOR_IR stream with profile: {type: OB_STREAM_IR, format: OB_FORMAT_Y16, width: 640, height: 576, fps: 30}, Backend Format: OB_FORMAT_Y16
[01/03 20:26:45.779514][info][2919092][VideoSensor.cpp:646] start OB_SENSOR_COLOR stream with profile: {type: OB_STREAM_COLOR, format: OB_FORMAT_BGRA, width: 1280, height: 720, fps: 30}, Backend Format: OB_FORMAT_MJPG
[01/03 20:26:45.781673][info][2919092][Pipeline.cpp:301] Start streams done!
[01/03 20:26:45.781692][info][2919092][Pipeline.cpp:277] Pipeline start done!
[01/03 20:26:45.782050][info][2919092][AccelSensor.cpp:27] AccelSensor created
[01/03 20:26:45.782068][info][2919092][FemtoBoltUvcDevice.cpp:690] Accel sensor has been created!
[01/03 20:26:45.782246][info][2919092][GyroSensor.cpp:28] GyroSensor created!
[01/03 20:26:45.782264][info][2919092][FemtoBoltUvcDevice.cpp:733] Gyro sensor has been created!
[01/03 20:27:55.420654][info][2919092][Pipeline.cpp:411] Try to stop pipeline!
[01/03 20:27:55.420734][info][2919092][Pipeline.cpp:383] Try to stop streams!
[01/03 20:27:57.381243][info][2919092][VideoSensor.cpp:734] Video sensor stopped, @OB_SENSOR_COLOR
[01/03 20:27:57.381281][info][2919092][Pipeline.cpp:396] Sensor stream stopped, sensorType=OB_SENSOR_COLOR
[01/03 20:27:57.381385][info][2919092][VideoSensor.cpp:734] Video sensor stopped, @OB_SENSOR_IR
[01/03 20:27:57.381407][info][2919092][Pipeline.cpp:396] Sensor stream stopped, sensorType=OB_SENSOR_IR
[01/03 20:27:57.381462][info][2919092][MSDEConverterDevice.cpp:620] Stop real profile,width:7680, height:434
[01/03 20:27:57.932183][info][2919092][VideoSensor.cpp:734] Video sensor stopped, @OB_SENSOR_DEPTH
[01/03 20:27:57.932218][info][2919092][Pipeline.cpp:396] Sensor stream stopped, sensorType=OB_SENSOR_DEPTH
[01/03 20:27:57.932243][info][2919092][Pipeline.cpp:402] Stop streams done!
[01/03 20:27:57.932917][info][2919092][Pipeline.cpp:443] Stop pipeline done!
[01/03 20:27:58.309936][info][2919092][Pipeline.cpp:411] Try to stop pipeline!
[01/03 20:27:58.309973][info][2919092][Pipeline.cpp:383] Try to stop streams!
[01/03 20:27:58.310038][warning][2919092][VideoSensor.cpp:680] Sensor(OB_SENSOR_COLOR) already stop.
[01/03 20:27:58.310061][info][2919092][Pipeline.cpp:396] Sensor stream stopped, sensorType=OB_SENSOR_COLOR
[01/03 20:27:58.310101][warning][2919092][VideoSensor.cpp:680] Sensor(OB_SENSOR_IR) already stop.
[01/03 20:27:58.310122][info][2919092][Pipeline.cpp:396] Sensor stream stopped, sensorType=OB_SENSOR_IR
[01/03 20:27:58.310159][warning][2919092][VideoSensor.cpp:680] Sensor(OB_SENSOR_DEPTH) already stop.
[01/03 20:27:58.310179][info][2919092][Pipeline.cpp:396] Sensor stream stopped, sensorType=OB_SENSOR_DEPTH
[01/03 20:27:58.310199][info][2919092][Pipeline.cpp:402] Stop streams done!
[01/03 20:27:58.310272][info][2919092][Pipeline.cpp:443] Stop pipeline done!
[01/03 20:27:58.310315][info][2919092][Pipeline.cpp:75] Pipeline destroyed! @0x55CC18E67460
[01/03 20:27:58.310352][info][2919092][FemtoBoltUvcDevice.cpp:42] ~FemtoBoltUvcDevice start!
[01/03 20:27:58.310428][info][2919092][FemtoBoltUvcDevice.cpp:53] ~FemtoBoltUvcDevice done!
[01/03 20:27:58.310487][info][2919092][VideoSensor.cpp:303] VideoSensor destroyed, @OB_SENSOR_IR
[01/03 20:27:58.310552][info][2919092][VideoSensor.cpp:303] VideoSensor destroyed, @OB_SENSOR_COLOR
[01/03 20:27:58.310610][info][2919092][VideoSensor.cpp:303] VideoSensor destroyed, @OB_SENSOR_DEPTH
[01/03 20:27:58.310652][info][2919092][AccelSensor.cpp:40] AccelSensor destroyed!
[01/03 20:27:58.310718][info][2919092][GyroSensor.cpp:41] GyroSensor destroyed!
[01/03 20:27:58.312466][info][2919092][ObLibuvcDevicePort.cpp:70] uvc_close done.
[01/03 20:27:58.312499][info][2919092][ObLibuvcDevicePort.cpp:71] ~ObLibuvcDevicePort done
[01/03 20:27:58.314633][info][2919092][ObLibuvcDevicePort.cpp:70] uvc_close done.
[01/03 20:27:58.314678][info][2919092][ObLibuvcDevicePort.cpp:71] ~ObLibuvcDevicePort done

Screenshots

Desktop (please complete the following information):

• OS with Version:

   $ lsb_release -a
   No LSB modules are available.
   Distributor ID:	Ubuntu
   Description:		Ubuntu 22.04.5 LTS
   Release:		22.04
   Codename:		jammy
  

• SDK Version: v1.10.3
• Firmware version:

Taken from OrbbecViewer:

Additional context

I am well aware of online resources such as your QA (especially point 3 as you suggested in another issue), however, that does not help because I am not in control of the source code of the k4aviewer. I just want to make sure it runs in general, which it doesn't.

Other than that, I cannot think of any additional context I could provide. But please let me know if you need anything.

Thanks in advance for any help!

[Deepcong2019]

一模一样的问题 解决了吗

[zhonghong322]

Please refer this FAQ，and test it.

For Linux user, there may be an issue with the initialization of DepthEngine when using Orbbec Femto Bolt due to modifications made by Microsoft in the new version of DepthEngine. This can cause failure during the start of the depth stream. The reason for this is that simultaneous use of multiple OpenGL contexts may result in conflicts. User can try to resolve it follow this: https://www.khronos.org/opengl/wiki/OpenGL_and_multithreading

For example：

// file: tools/k4aviewer/k4adevicedockcontrol.cpp
GLFWwindow *currentContext = glfwGetCurrentContext(); // store the current context
glfwMakeContextCurrent(NULL); // make current context to NULL

StartCameras(); // will initialize the DepthEngine

glfwMakeContextCurrent(currentContext); // restore the current context