Using imx219 camera with thunder boot

Fuzzy1 · April 28, 2022, 1:10am

I have a camera with a imx219 sensor that is connected to the mother board (JD4-
RV11091126) with Core-1126-JD4 and I have managed to capture frames in normal mode (build file aio-rv1126-jd4-BE-45.mk).

When I enable thunder boot with aio-rv1126-jd4-BE-45-tb-v11.mk no frames are captured.
How to fix this?

grep '' /sys/class/video4linux/video*/name
/sys/class/video4linux/video0/name:rkisp_rawrd0_m
/sys/class/video4linux/video1/name:rkisp_rawrd1_l
/sys/class/video4linux/video10/name:rkisp_rawrd2_s
/sys/class/video4linux/video11/name:rkisp-mipi-luma
/sys/class/video4linux/video12/name:stream_cif_mipi_id0
/sys/class/video4linux/video13/name:stream_cif_mipi_id1
/sys/class/video4linux/video14/name:stream_cif_mipi_id2
/sys/class/video4linux/video15/name:stream_cif_mipi_id3
/sys/class/video4linux/video16/name:rkcif-mipi-luma
/sys/class/video4linux/video2/name:rkisp-statistics
/sys/class/video4linux/video3/name:rkisp_mainpath
/sys/class/video4linux/video4/name:rkisp_selfpath
/sys/class/video4linux/video5/name:rkisp_rawwr0
/sys/class/video4linux/video6/name:rkisp_rawwr1
/sys/class/video4linux/video7/name:rkisp-input-params
/sys/class/video4linux/video8/name:rkisp_rawwr2
/sys/class/video4linux/video9/name:rkisp_rawwr3

v4l2-ctl -d /dev/video4 --set-fmt-video=width=640,height=480,pixelformat=NV12
--stream-mmap=3 --stream-skip=3 --stream-to=/tmp/nv12.bin --stream-count=100 --s
tream-poll
select timeout

[   41.913678] rkisp0: rkisp_isp_sd_s_power on:1
[   41.914059] videodev: v4l2_open: video6: open (0)
[   41.914137] video6: VIDIOC_QUERYCAP: driver=rkisp_v4, card=rkisp_selfpath, bus=platform:rkisp-vir0, version=0x0004136f, capabilities=0x84201000, device_caps=0x04201000
[   41.914167] video6: VIDIOC_QUERY_EXT_CTRL: id=0x980001, type=6, name=User Controls, min/max=0/0, step=0, default=0, flags=0x00000044, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[   41.914185] video6: VIDIOC_TRY_EXT_CTRLS: which=0x0, count=0, error_idx=0
[   41.914198] video6: VIDIOC_QUERYCTRL: id=0x980001, type=6, name=User Controls, min/max=0/0, step=0, default=0, flags=0x00000044
[   41.914211] video6: VIDIOC_G_SELECTION: type=vid-cap, target=0, flags=0x0, wxh=1920x1080, x,y=0,0
[   41.914224] video6: VIDIOC_QUERYCAP: driver=rkisp_v4, card=rkisp_selfpath, bus=platform:rkisp-vir0, version=0x0004136f, capabilities=0x84201000, device_caps=0x04201000
[   41.914465] video6: VIDIOC_QUERY_EXT_CTRL: id=0x980001, type=6, name=User Controls, min/max=0/0, step=0, default=0, flags=0x00000044, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[   41.914486] video6: VIDIOC_QUERY_EXT_CTRL: id=0x980001, type=6, name=User Controls, min/max=0/0, step=0, default=0, flags=0x00000044, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[   41.914502] video6: VIDIOC_QUERY_EXT_CTRL: id=0x980911, type=1, name=Exposure, min/max=0/4095, step=1, default=1575, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[   41.914563] video6: VIDIOC_QUERY_EXT_CTRL: id=0x980913, type=1, name=Gain, min/max=256/43663, step=1, default=256, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[   41.914589] video6: VIDIOC_QUERY_EXT_CTRL: id=0x980914, type=2, name=Horizontal Flip, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[   41.914618] video6: VIDIOC_QUERY_EXT_CTRL: id=0x980915, type=2, name=Vertical Flip, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[   41.914642] video6: VIDIOC_QUERY_EXT_CTRL: id=0x9e0001, type=6, name=Image Source Controls, min/max=0/0, step=0, default=0, flags=0x00000044, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[   41.914658] video6: VIDIOC_QUERY_EXT_CTRL: id=0x9e0901, type=1, name=Vertical Blanking, min/max=686/686, step=1, default=686, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[   41.914723] video6: VIDIOC_QUERY_EXT_CTRL: id=0x9e0902, type=1, name=Horizontal Blanking, min/max=1524/1524, step=1, default=1524, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[   41.914752] video6: VIDIOC_QUERY_EXT_CTRL: id=0x9e0903, type=1, name=Analogue Gain, min/max=256/2816, step=1, default=512, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[   41.914776] video6: VIDIOC_QUERY_EXT_CTRL: id=0x9f0001, type=6, name=Image Processing Controls, min/max=0/0, step=0, default=0, flags=0x00000044, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[   41.914792] video6: VIDIOC_QUERY_EXT_CTRL: id=0x9f0901, type=9, name=Link Frequency, min/max=0/0, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[   41.914816] video6: VIDIOC_QUERY_EXT_CTRL: id=0x9f0902, type=5, name=Pixel Rate, min/max=0/182463120, step=1, default=182463120, flags=0x00000004, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[   41.914839] video6: VIDIOC_QUERY_EXT_CTRL: id=0x9f0903, type=3, name=Test Pattern, min/max=0/13, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[   41.914862] video6: VIDIOC_QUERY_EXT_CTRL: error -22: id=0xc09f0903, type=0, name=, min/max=0/0, step=0, default=0, flags=0x00000000, elem_size=0, elems=0, nr_of_dims=0, dims=0,0,0,0
[   41.914884] video6: VIDIOC_G_FMT: type=vid-cap-mplane, width=1920, height=1080, format=NV12, field=none, colorspace=0, num_planes=1, flags=0x0, ycbcr_enc=0, quantization=1, xfer_func=0
[   41.914962] plane 0: bytesperline=1920 sizeimage=3110400
[   41.914982] rkisp0: rkisp_set_fmt: stream: 1 req(640, 480) out(640, 480)
[   41.914984] video6: VIDIOC_S_FMT: type=vid-cap-mplane, width=640, height=480, format=NV12, field=none, colorspace=0, num_planes=1, flags=0x0, ycbcr_enc=0, quantization=1, xfer_func=0
[   41.914996] plane 0: bytesperline=640 sizeimage=460800
[   41.915072] video6: VIDIOC_SUBSCRIBE_EVENT: error -25: type=0x2, id=0x0, flags=0x0
[   41.915090] video6: VIDIOC_SUBSCRIBE_EVENT: error -25: type=0x5, id=0x0, flags=0x0
[   41.915101] video6: VIDIOC_G_INPUT: error -25: value=0
[   41.915252] rkisp0: vid-cap-mplane count 3, size 460800
[   41.915308] rkisp0: rkisp_alloc_buffer buf:0xc804000~0xcaa7000 size:2764800
[   41.915316] rkisp0: rkisp_alloc_common_dummy_buf buf:0xc804000 size:2764800
[   41.915336] videobuf2_common: __setup_offsets: buffer 0, plane 0 offset 0x00000000
[   41.915349] videobuf2_common: __setup_offsets: buffer 1, plane 0 offset 0x00071000
[   41.915360] videobuf2_common: __setup_offsets: buffer 2, plane 0 offset 0x000e2000
[   41.915364] videobuf2_common: __vb2_queue_alloc: allocated 3 buffers, 1 plane(s) each
[   41.915369] video6: VIDIOC_REQBUFS: count=3, type=vid-cap-mplane, memory=mmap
[   41.915400] video6: VIDIOC_QUERYBUF: 00:00:00.00000000 index=0, type=vid-cap-mplane, flags=0x00002000, field=any, sequence=0, memory=mmap
[   41.915417] plane 0: bytesused=0, data_offset=0x00000000, offset/userptr=0x0, length=460800
[   41.915422] timecode=00:00:00 type=0, flags=0x00000000, frames=0, userbits=0x00000000
[   41.915435] video6: VIDIOC_QUERYBUF: 00:00:00.00000000 index=1, type=vid-cap-mplane, flags=0x00002000, field=any, sequence=0, memory=mmap
[   41.915449] plane 0: bytesused=0, data_offset=0x00000000, offset/userptr=0x71000, length=460800
[   41.915453] timecode=00:00:00 type=0, flags=0x00000000, frames=0, userbits=0x00000000
[   41.915460] video6: VIDIOC_QUERYBUF: 00:00:00.00000000 index=2, type=vid-cap-mplane, flags=0x00002000, field=any, sequence=0, memory=mmap
[   41.915473] plane 0: bytesused=0, data_offset=0x00000000, offset/userptr=0xe2000, length=460800
[   41.915478] timecode=00:00:00 type=0, flags=0x00000000, frames=0, userbits=0x00000000
[   41.915593] videobuf2_common: vb2_mmap: buffer 0, plane 0 successfully mapped
[   41.915597] videodev: v4l2_mmap: video6: mmap (0)
[   41.915674] videobuf2_common: vb2_mmap: buffer 1, plane 0 successfully mapped
[   41.915677] videodev: v4l2_mmap: video6: mmap (0)
[   41.915747] videobuf2_common: vb2_mmap: buffer 2, plane 0 successfully mapped
[   41.915750] videodev: v4l2_mmap: video6: mmap (0)
[   41.915819] videobuf2_common: vb2_core_qbuf: qbuf of buffer 0 succeeded
[   41.915821] video6: VIDIOC_QBUF: 00:00:00.00000000 index=0, type=vid-cap-mplane, flags=0x00002003, field=any, sequence=0, memory=mmap
[   41.915834] plane 0: bytesused=0, data_offset=0x00000000, offset/userptr=0x0, length=460800
[   41.915839] timecode=00:00:00 type=0, flags=0x00000000, frames=0, userbits=0x00000000
[   41.915897] videobuf2_common: vb2_core_qbuf: qbuf of buffer 1 succeeded
[   41.915900] video6: VIDIOC_QBUF: 00:00:00.00000000 index=1, type=vid-cap-mplane, flags=0x00002003, field=any, sequence=0, memory=mmap
[   41.915912] plane 0: bytesused=0, data_offset=0x00000000, offset/userptr=0x71000, length=460800
[   41.915917] timecode=00:00:00 type=0, flags=0x00000000, frames=0, userbits=0x00000000
[   41.915976] videobuf2_common: vb2_core_qbuf: qbuf of buffer 2 succeeded
[   41.915978] video6: VIDIOC_QBUF: 00:00:00.00000000 index=2, type=vid-cap-mplane, flags=0x00002003, field=any, sequence=0, memory=mmap
[   41.915991] plane 0: bytesused=0, data_offset=0x00000000, offset/userptr=0xe2000, length=460800
[   41.915995] timecode=00:00:00 type=0, flags=0x00000000, frames=0, userbits=0x00000000
[   41.916003] video6: VIDIOC_G_FMT: type=vid-cap-mplane, width=640, height=480, format=NV12, field=none, colorspace=0, num_planes=1, flags=0x0, ycbcr_enc=0, quantization=1, xfer_func=0
[   41.916017] plane 0: bytesperline=640 sizeimage=460800
[   41.916057] rkisp0: rkisp_start_streaming 1
[   41.916076] rkisp0: CSI ch0 vc:0 dt:0x2b 1920x1080
[   41.916081] rkisp0: CSI ch1 vc:0 dt:0x2b 1920x1080
[   41.916085] rkisp0: CSI ch2 vc:0 dt:0x2b 1920x1080
[   41.916089] rkisp0: CSI ch3 vc:0 dt:0x2b 1920x1080
[   41.916094] rkisp0: CSI ch4 vc:0 dt:0x2b 1920x1080
[   41.916192] rkisp0: CSI2RX_IDS 0x2b2b2b2b 0x0000002b
[   41.916201] rkisp0: stream 1 rsz/scale: 1920x1080 -> 640x480
[   41.916204] rkisp0: chroma scaling 960x1080 -> 320x240
[   41.916245] RSZ_CTRL 0x0000000f/0x0000000f
[   41.916245] RSZ_SCALE_HY 21823/21823
[   41.916245] RSZ_SCALE_HCB 21800/21800
[   41.916245] RSZ_SCALE_HCR 21800/21800
[   41.916245] RSZ_SCALE_VY 29094/29094
[   41.916245] RSZ_SCALE_VC 14517/14517
[   41.916245] RSZ_PHASE_HY 0/0
[   41.916245] RSZ_PHASE_HC 0/0
[   41.916245] RSZ_PHASE_VY 0/0
[   41.916245] RSZ_PHASE_VC 0/0
[   41.916249] rkisp0: stream 1 crop disabled
[   41.916275] rkisp0: CSI2RX CTRL0:0x20820000 CTRL1:0x1
[   41.916275] WR CTRL RAW0:0x2e0200 RAW1:0x200 RAW2:0x100
[   41.916275] RD CTRL:0x0
[   41.916286] rkisp0: SP streaming = 1, MP streaming = 0
[   41.916289] rkisp0: CIF_ID 0x02001909
[   41.916307] rkisp rkisp-vir0: can not get first iq setting in stream on
[   41.916320] rkisp0: SP streaming = 1, MP streaming = 0
[   41.917675] rkisp0: SP streaming = 1, MP streaming = 0 MI_CTRL 0x193a4002
[   41.917675]   ISP_CTRL 0x80446117 MIPI_CTRL 0x20820001
[   41.917693] rockchip-mipi-dphy-rx ff4b8000.csi-dphy: stream on:1
[   41.917705] rockchip-mipi-dphy-rx: data_rate_mbps 912
[   41.921106] rockchip-mipi-dphy-rx ff4b8000.csi-dphy: stream on:0
[   41.922155] rkisp0: SP streaming = 1, MP streaming = 0
[   41.922167] rkisp0: streaming(MP:1, SP:0), MI_CTRL:193a4002, ISP_CTRL:80446106, MIPI_CTRL:20820001
[   41.922363] rkisp0: rkisp_free_buffer buf:0xc804000~0xcaa7000
[   41.922379] videobuf2_common: vb2_buffer_done: done processing on buffer 2, state: 3
[   41.922384] videobuf2_common: vb2_buffer_done: done processing on buffer 0, state: 3
[   41.922387] videobuf2_common: vb2_buffer_done: done processing on buffer 1, state: 3
[   41.922391] videobuf2_common: vb2_start_streaming: driver refused to start streaming
[   41.922395] video6: VIDIOC_STREAMON: error -5: type=vid-cap-mplane
[   41.923565] videobuf2_common: __vb2_buf_mem_free: freed plane 0 of buffer 0
[   41.923574] videobuf2_common: __vb2_buf_mem_free: freed plane 0 of buffer 1
[   41.923583] videobuf2_common: __vb2_buf_mem_free: freed plane 0 of buffer 2
[   41.923650] rkisp0: rkisp_isp_sd_s_power on:0
[   41.923678] videodev: v4l2_release: video6: release

799959745 · April 28, 2022, 6:58am

Does the camera work normally when it starts up?
test mk：

./build.sh device/rockchip/rv1126_rv1109/aio-rv1126-jd4-BE-45.mk

Fuzzy1 · April 28, 2022, 8:15am

799959745 Posted at 4/28/2022 14:58
Does the camera work normally when it starts up?
test mk：

Yes, the camera is detected.

[    0.454200] imx219 2-0010: Model ID 0x0219, Lot ID 0x3b2454, Chip ID 0x0633
[    0.454286] rockchip-mipi-dphy-rx ff4b8000.csi-dphy: match m01_f_imx219 2-0010:bus type 4

Fuzzy1 · May 1, 2022, 12:48pm

Some more info:

# gst-launch-1.0 v4l2src device=/dev/video1 num-buffers=100 ! video/x-raw,format
=NV12,width=640,height=480,framerate=30/1 ! filesink location=/tmp/h264.bin
Setting pipeline to PAUSED ...
Using mplane plugin for capture
Pipeline is live and does not need PREROLL ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
libv4l2: error turning on stream: Input/output error
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Failed to allocate required memory.
Additional debug info:
gstv4l2src.c(658): gst_v4l2src_decide_allocation (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0:
Buffer pool activation failed
Execution ended after 0:00:00.009998917
Setting pipeline to PAUSED ...
Setting pipeline to READY ...
Setting pipeline to NULL ...
Freeing pipeline ...

Fuzzy1 · May 2, 2022, 8:01am

Can someone verify that MIPI CSI cameras can be used with Thunder Boot and non Quick Snapshot mode?

799959745 · May 5, 2022, 3:05am

Fuzzy1 Posted at 5/1/2022 20:48
Some more info:

Please do not use gstreamer to take pictures.
Please use v4l2-ctl to take pictures.

Fuzzy1 · May 5, 2022, 7:09am

799959745 Posted at 5/5/2022 11:05
Please do not use gstreamer to take pictures.
Please use v4l2-ctl to take pictures.

Yes, but in my previous post I use v4l2-ctl:

    v4l2-ctl -d /dev/video4 --set-fmt-video=width=640,height=480,pixelformat=NV12
    --stream-mmap=3 --stream-skip=3 --stream-to=/tmp/nv12.bin --stream-count=100 --s
    tream-poll
    select timeout

799959745 · May 10, 2022, 1:37am

Fuzzy1 Posted at 5/5/2022 15:09
Yes, but in my previous post I use v4l2-ctl:

Maybe the configuration is wrong. It is not within our support.

Fuzzy1 · May 10, 2022, 7:16pm

799959745 Posted at 5/10/2022 09:37
Maybe the configuration is wrong. It is not within our support.

Ok, I understand.

But if I buy the 4M Camera Module OS04A10 then I can use it it with Thunder Boot and Quick Snapshot mode, right?

799959745 · May 11, 2022, 1:20am

Fuzzy1 Posted at 5/11/2022 03:16
Ok, I understand.

But if I buy the 4M Camera Module OS04A10 then I can use it it with Thunder B …

A Thunder Boot is fine. But the Quick Snapshot mode has not been tried, it should also be possible.

boarsystem · May 11, 2022, 10:27am

799959745 Posted at 5/11/2022 09:20
A Thunder Boot is fine. But the Quick Snapshot mode has not been tried, it should also be possible …

I have ordered the OS04A10 camera, so hopefully I can use it with Thunder Boot with or without Snapshot Mode.

Fuzzy1 · May 12, 2022, 9:13pm

Some more questions:

I noticed that there are Quick Snapshot MCU firmware for imx415 (rv1126_riscv_imx415_3864_2192_SGBRG10_compact_v1.00.bin), os04c10 (rv1126_riscv_os04c10_2688_1520_SBGGR10_compact_v1.10.bin) and sc210iot (rv1126_riscv_sc210iot_1920_1080_SBGGR10_compact_v1.00.bin) but not for OS04A10.

Is there Quick Snapshot firmware available for OS04A10?

Has the document Rockchip_Developer_Guide_RV1126_RV1109_Battery_Product_EN.pdf been updated recently by Rockchip? Current version in the Firefly SDK is v1.6.1.

Does additional information exist about how to program the MCU? The documentation mentions for example the directory bsp/rockchip/rv1126-riscv but I can’t find a similar path in the Firefly SDK.

799959745 · May 14, 2022, 8:39am

Fuzzy1 Posted at 5/13/2022 05:13
Some more questions:

There is no firmware for taking quick pictures. But it supports quick photo shooting. You can try it out by following the documentation first.

Fuzzy1 · May 14, 2022, 11:53am

I read the information provided in Rockchip_Developer_Guide_RV1126_RV1109_Battery_Product_EN.pdf, but there is really no information about how to write code for the MCU.

Is there additional documentation somewhere?

Is there source files for the MCU that can be studied and compiled?

799959745 · May 17, 2022, 6:44am

Fuzzy1 Posted at 5/14/2022 19:53
I read the information provided in Rockchip_Developer_Guide_RV1126_RV1109_Battery_Product_EN.pdf, bu …

This part of rockchip has not released relevant information.

Fuzzy1 · August 11, 2022, 8:00pm

I found out that if I use I2C1 instead of I2C2 it works fine. So there’s probably some kind of bug which prevents using I2C2 with Thunder Boot enabled.

samgray282 · January 15, 2026, 9:45am

What a phenomenal read, I truly appreciate you sharing it! Good luck on your exams! Here are the free C_P2WIE_2404 latest exam pdf questions for you.

kevinne286 · January 18, 2026, 9:26am

Can’t get enough of this content, definitely liking it. The BUS105 reliable braindumps questions content is truly helpful, and it’s offered without any cost.

rickyou492 · February 11, 2026, 11:27pm

I’m giving this a like without even thinking twice. The C_HRHPC_2505 new practice questions ppt test questions are the key to career success—now shared for free!