Access content on the eMMc memory module of the OAK-D PoE camera

MariosConstantinou

Hello all,

We have a Luxonis OAK-D PoE camera, and we want to use it in standalone mode. Basically we want to deploy it somewhere, have it automatically get some pictures, and then when we retrieve it, we want to get those pictures from its memory and run some pre-processing on it.

I've looked at the documentation and I could not find any way to access that memory. The only page I found that somewhat does what I am looking for is this, but what this script actually does is that it takes pictures in real-time, saves them on memory and then with opencv, streams those images.

What I want to do is do grab the images that are already saved on the camera.

Thank you very much!

Regards,

Marios

jakaskerl

MariosConstantinou
The script uses two separate processes. If you only wish to view the saved images, then just remove the first process and only keep

#Set a read script
script_read = pipeline.createScript()
script_read.setProcessor(dai.ProcessorType.LEON_CSS)
script_read.setScript("""

    import http.server
    import socketserver
    import socket
    import fcntl
    import struct
    import os

    def get_ip_address(ifname):
        s = socket.socket(socket.AF_INET, socket.SOCK_DGRAM)
        return socket.inet_ntoa(fcntl.ioctl(
            s.fileno(),
            -1071617759,  # SIOCGIFADDR
            struct.pack('256s', ifname[:15].encode())
        )[20:24])

    # Note: `chdir` here will prevent unmount, this should be improved!
    os.chdir('/media/mmcsd-0-0')

    PORT = 80
    Handler = http.server.SimpleHTTPRequestHandler

    with socketserver.TCPServer(("", PORT), Handler) as httpd:
        ip = get_ip_address('re0')
        node.warn(f'===== HTTP file server accessible at: http://{ip}')
        httpd.serve_forever()

""")

removing the saving process will not affect the reading one.

Thanks,
Jaka

MariosConstantinou

jakaskerl

Hi Jakaskerl

So I managed to run the HTTP server by using this script:

import cv2

import depthai as dai

pipeline = dai.Pipeline()

board = dai.BoardConfig()

board.emmc = True

pipeline.setBoardConfig(board)

script_node = pipeline.create(dai.node.Script)

script_node.setProcessor(dai.ProcessorType.LEON_CSS)

script_node.setScript("""

import http.server

import socketserver

import socket

import fcntl

import struct

import os

dirs_list = os.listdir()
node.warn(f'{dirs_list}')

def get_ip_address(ifname):

s = socket.socket(socket.AF_INET, socket.SOCK_DGRAM)

return socket.inet_ntoa(fcntl.ioctl(

    s.fileno(),

    -1071617759,  # SIOCGIFADDR

    struct.pack('256s', ifname[:15].encode())

)[20:24])

# Note: `chdir` here will prevent unmount, this should be improved!

# os.chdir('/media/mmcsd-0-0')

if os.path.exists('/media/mmcsd-0-0/'):

node.warn('Media Path found')

else:

node.warn('Media Path not found')

PORT = 8080

Handler = http.server.SimpleHTTPRequestHandler

with socketserver.TCPServer(("", PORT), Handler) as httpd:

ip = get_ip_address('re0')

node.warn(f'===== HTTP file server accessible at: http://{ip}:{PORT}')

httpd.serve_forever()

""")

with dai.Device(pipeline) as device:

while True:

    if cv2.waitKey(1) == ord('q'):

        break

The result is this:

[14442C1001374ED400] [169.254.1.222] [23.779] [Script(0)] [warning] ['dev', 'etc', 'var']

[14442C1001374ED400] [169.254.1.222] [23.779] [Script(0)] [warning] Media Path not found

[14442C1001374ED400] [169.254.1.222] [23.781] [Script(0)] [warning] ===== HTTP file server accessible at: http://169.254.1.222:8080

I then run this script:

import depthai as dai

# Create pipeline
pipeline = dai.Pipeline()

# Set board config
board = dai.BoardConfig()

board.emmc = True

config = dai.Device.Config()

config.board = board

pipeline.setBoardConfig(board)

(f, bl) = dai.DeviceBootloader.getFirstAvailableDevice()

bootloader = dai.DeviceBootloader(bl)

progress = lambda p : print(f'Flashing progress: {p*100:.1f}%')

(r, errmsg) = bootloader.flash(progress, pipeline, memory=dai.DeviceBootloader.Memory.EMMC)

if r: print("Flash OK")

And then I run the http script again. I got the same result. There's no /media/mmcsd-0-0 path.

Do you know why this would happen?

I also run the script_emmc_access.py script inside depthai-python/examples/Scripts and I get the following error

[14442C1001374ED400] [169.254.1.222] [47.931] [Script(3)] [critical] FileNotFoundError: [Errno 2] N: '/media/mmcsd-0-0'

At:

<script>(19): <module>

Traceback (most recent call last):

File "C:\Users\mar.constantinou\Desktop\luxonis\depthai-python\examples\Script\script_emmc_access.py", line 92, in <module>
inRgb = qRgb.tryGet()
RuntimeError: Communication exception - possible device error/misconfiguration. Original message 'Couldn't read data from stream: 'rgb' (X_LINK_ERROR)'

jakaskerl

MariosConstantinou
Make sure you are running the latest bootloader version (0.0.28) and that EMMC is available on your device:

https://docs.luxonis.com/software/depthai/examples/bootloader_version/

Modified script:

import cv2
import depthai as dai

# Create pipeline
pipeline = dai.Pipeline()

# Set board config to enable eMMC
board = dai.BoardConfig()
board.emmc = True
pipeline.setBoardConfig(board)

# Create a Script node
script_node = pipeline.create(dai.node.Script)
script_node.setProcessor(dai.ProcessorType.LEON_CSS)

# Set the script content
script_node.setScript("""
import http.server
import socketserver
import socket
import struct
import os

def get_ip_address(ifname):
    import fcntl
    s = socket.socket(socket.AF_INET, socket.SOCK_DGRAM)
    return socket.inet_ntoa(fcntl.ioctl(
        s.fileno(),
        0x8915,  # SIOCGIFADDR
        struct.pack('256s', ifname[:15].encode())
    )[20:24])

# Check if eMMC is mounted
media_path = '/media/mmcsd-0-0'
if os.path.exists(media_path):
    node.warn('Media Path found.')
    os.chdir(media_path)
else:
    node.warn('Media Path not found.')
    # Attempt to mount the eMMC
    mount_result = os.system(f'mount /dev/mmcblk0p1 {media_path}')
    if mount_result == 0 and os.path.exists(media_path):
        node.warn('Mounted eMMC successfully.')
        os.chdir(media_path)
    else:
        node.warn('Failed to mount eMMC.')

PORT = 8080
Handler = http.server.SimpleHTTPRequestHandler

with socketserver.TCPServer(("", PORT), Handler) as httpd:
    try:
        ip = get_ip_address('re0')
    except Exception as e:
        node.warn(f'Error getting IP address: {e}')
        ip = 'localhost'
    node.warn(f'===== HTTP file server accessible at: http://{ip}:{PORT}')
    httpd.serve_forever()
""")

# Connect to device and run the pipeline
with dai.Device(pipeline) as device:
    print("Device started. Press 'q' to exit.")
    while True:
        if cv2.waitKey(1) == ord('q'):
            break

Thanks,
Jaka

MariosConstantinou

jakaskerl

Thank you for the swift reply Jaka!

The problem was my conda environment. Something must have messed up the dependencies.

Creating a new one from scratch fixed the problem, and I am able to see the directory.

Your modified script works as well!

Warm regards,

Marios