dispatcherResponseServe:925 error

biwu

Hi, Jaka,

I sometimes encounter this error, especially when running record (SDK) function with a high fps e.g. fps=30 or 60 to encode with MJPEG option:
F: [global] [ 0] [ThreadN] dispatcherResponseServe:925 no request for this response: XLINK_WRITE_RESP 1

Not always, but sometimes it happened like 50-50 chances. Any clue to make it stable? Power, bandwidth or anything?

Also, I noticed that in 'av_writer.py', the width and height was not specified when creating new stream, which lead to the meta data of video always with width and height as 640x480, even when I specified the resolution of video as '1080p'. Perhaps we need to add some lines to specify the width and height of frames in recording the video?

Thanks a lot!
Wu Bi

jakaskerl

Hi biwu
Could you share a MRE please? The one with the highest error occurrence you can get.

biwu 'av_writer.py', the width and height was not specified when creating new stream

The width and height should be automatically set when passing a frame to the write method. Is the shape not recognized correctly? Try adding a print statement inside av_writer.py under line 158 shape = self.get_dimension(frame) to check.

Perhaps we need to add some additional type checks.

Thanks,
Jaka

biwu

Hi, Jaka,

About the "av_writer.py" in my env: C:...\myenv\Lib\site-packages\depthai_sdk\recorders\video_writers\av_writer.py, I am not having 158 lines, I upload here. Maybe is the version problem? (I follow everything on the webpage: https://github.com/luxonis/depthai) (I couldn't make a proper insert code here):
from datetime import timedelta from fractions import Fraction from pathlib import Path
import depthai as dai

from depthai_sdk.recorders.video_writers import AbstractWriter from depthai_sdk.recorders.video_writers.utils import create_writer_dir

class AvWriter(AbstractWriter):
start_ts: timedelta = None
file = None

def __init__(self, folder: Path, name: str, fourcc: str, fps: float):
    global av
    import av as av

    name = create_writer_dir(folder, name, 'mp4')

    self.start_ts = None
    self.folder = folder
    self.file = av.open(name, 'w')
    self._fps = fps
    self._fourcc = fourcc

    self._create_stream(self.file, fourcc, fps)

def _create_stream(self, file, fourcc, fps) -> None:
    """Create stream in file with given fourcc and fps, works in-place."""
    stream = file.add_stream(fourcc, rate=int(fps))
    stream.time_base = Fraction(1, 1000 * 1000)  # Microseconds

    # We need to set pixel format for MJEPG, for H264/H265 it's yuv420p by default
    if fourcc == 'mjpeg':
        stream.pix_fmt = 'yuvj420p'

def write(self, frame: dai.ImgFrame) -> None:
    packet = av.Packet(frame.getData())  # Create new packet with byte array

    # Set frame timestamp
    if self.start_ts is None:
        self.start_ts = frame.getTimestampDevice()

    ts = int((frame.getTimestampDevice() - self.start_ts).total_seconds() * 1e6)  # To microsec
    packet.dts = ts
    packet.pts = ts

    self.file.mux_one(packet)  # Mux the Packet into container

def close(self):
    self.file.close()

Here are the two ways of recording I used to produce the error (Both are able to produce the error):

Test 1

from depthai_sdk import OakCamera, RecordType import time with OakCamera() as oak: color = oak.create_camera('color', resolution='1080P', fps=60, encode='MJPEG') oak.visualize([color.out.encoded],fps=True) #optional oak.record([color.out.encoded], './record') oak.start() start_time = time.monotonic() while oak.running(): if time.monotonic() - start_time > 5: break oak.poll()

Test 2

from depthai_sdk import OakCamera from depthai_sdk.record import RecordType with OakCamera() as oak: color = oak.create_camera('color', resolution='1080p', fps=60, encode='mjpeg') oak.record([color], path='./records', record_type=RecordType.VIDEO) oak.visualize([color.out.encoded]) oak.start(blocking=True)

Also I noticed that in Test 1, I can't reach 60 fps in the recorded video, but the Test 2 is able to. Could you also help to explain why? I would prefer the recording result from Test 2, but prefer a way of controlling the record like Test 1. Could you advice how to make a controllable record function with 60 fps MJPG vide? (record from SDK doesn't have a callback feature, correct?)

Thanks and Regards
Wu Bi

jakaskerl

Hi biwu
Looks like you have an outdated version of depthai repository installed.

https://github.com/luxonis/depthai/blob/main/depthai_sdk/src/depthai_sdk/recorders/video_writers/av_writer.py does have more that 158 lines.
Please update that first using git pull, then retry.

Thanks,
Jaka

biwu

jakaskerl

Hi, Jaka,

I am a little confused, because I found out that I'm having two DepthAI_SDK in my vs code folder. One is in my own virtual environment (this is the old version that doesn't have 158 lines), another is under my working folder (this is the right version I think). How do I make sure i import the right version or package? Could you help a bit? (I did follow from Github to make the installation, or do I miss out anything?)

Thanks a lot!
Wu BI

jakaskerl

Hi biwu
You can run python3 -m pip install depthai_sdk -U inside your virtual environment to update the SDK version. Alternatively, you can use git pull to update the depthai repository and build the python package from source. I guess the first option is easier.

To see which version you are using inside of the venv, try:

import depthai_sdk
print(depthai_sdk.__file__)

Hope this helps,
Jaka

biwu

Hi, Jaka,

After python3 -m pip install depthai_sdk -U, I got the packages in order and the data is correct. However, I got this error [2023-09-28 21:59:30] WARNING [libav.swscaler.decode:108] deprecated pixel format used, make sure you did set range correctly for this code below:

from depthai_sdk import OakCamera, RecordType import time with OakCamera() as oak:
color = oak.create_camera('color', resolution='1080P', fps=60, encode='MJPEG')

oak.visualize([color.out.encoded],fps=True)     #optional
# Sync & save all (encoded) streams
oak.record([color.out.encoded], './record')
oak.start()
start_time = time.monotonic()
while oak.running():
    if time.monotonic() - start_time > 5:
        break
    oak.poll()`

what does the error mean?

Best Regards
Wu Bi

jakaskerl

Hi biwu
Would I be right to assume this error appears after you have ended the recording?
The libav.swscaler.decode is part of ffmpeg i think, which is used at the end to decode the encoded streams to mp4 (or whatever). I guess updating the ffmpeg should resolve this issue.

Thanks,
Jaka