Hello Luxonis Team,

I have deployed a defect detection model on an OAK-D CM4 POE camera. My goal is to send a signal to an automated machine (such as a blower or mechanical arm) whenever a defect is detected. The machine would then act on the detected objects, moving them to the side. Also would be helpful for what king of automated machines work well with OAK Cameras.

I would like to know if the OAK-D CM4 POE camera can be used for this use case and what types of signals it can send to communicate with the machine. Could you also point me to any relevant documentation or example use cases if possible?

Thank you and looking forward to hearing from you.

Have a great day and best regards,

    GurdeepakSidhu
    Since the CM4 POE is closed off, your only real option is ethernet. You can use TCP/UDP/MQTT to control the machine.
    For communication, basically google how to interface your specific machine to a linux system (which is what a RPI is).

    For example, if using MODBUS, this is how it can be done:

    from pymodbus.client.sync import ModbusTcpClient
    
    # Connect to the PLC
    plc_ip = "192.168.1.200"
    plc_port = 502
    client = ModbusTcpClient(plc_ip, port=plc_port)
    
    # Send a signal to trigger an actuator
    client.write_coil(1, True)  # Write to coil 1 (ON)
    client.write_coil(1, False)  # Write to coil 1 (OFF)
    
    # Close connection
    client.close()

    Thanks,
    Jaka

    @jakaskerl

    Hello and thank you for your recommendation! This is helpful.

    What does it mean that the OAK D CM4 is closed off? Is there more options on sending signal if we use a different OAK Camera?

    Thank you and have a great day!
    I look forward to hearing back from you.

      GurdeepakSidhu
      CM4 is enclosed in a case. The only outputs you can get are either ETH or some wireless means (WIFI, BT if you have a dongle, etc).
      If you were to use a FFC-4P style device you could expose UART, if you used M12/M8 POE devices you should also be able to expose GPIOs, ..

      Thanks,
      Jaka

      @jakaskerl Thank you for your response and further clarification.
      This is helpful for me to understand the possible ways to send a signal from the camera and communicate with an external hardware.

      Would you be able to send camera options that supports FFC-4P (Expose UART) and M12/M8 POE devices?

      This would be helpful and much appreciated.

      Thank you and have a great day!
      Best regards,

        GurdeepakSidhu

        GurdeepakSidhu Would you be able to send camera options that supports FFC-4P (Expose UART) and M12/M8 POE devices?

        https://docs.luxonis.com/hardware/?f-conn=poe_m12 for M12/M8 options. There is a single GPIO pin exposed on the M8 connector (1 or 7 depending on the version).

        FFC- style devices: https://shop.luxonis.com/collections/oak-modules/?q=filter_tag%3dtype-base+module&sort_by=manual These have exposed aux pins for UART (and SPI):

        Thanks,
        Jaka

        @jakaskerl

        Thank you for sending the options above for both M12/M8 and UART.
        For OAK Cameras integrated with a host system (like OAK-D-CM4 POE, with raspberry host) the only option for communication would be thru Network/Etherent?

        For our use case we do need to have the camera integrated with host system. Would the OAK 4 camera's that are coming out integrated with host and also supports sending signals thru Network/Ethernet? ( Possibly M12/M8 and UART options as well).

        Thank you and have a great day.
        Best regards!

          GurdeepakSidhu For OAK Cameras integrated with a host system (like OAK-D-CM4 POE, with raspberry host) the only option for communication would be thru Network/Etherent?

          If the device is in the enclosure, yes. If it is open or if you drill through the enclosure and have wires coming out, you should have access to GPIOs and UART.

          GurdeepakSidhu Would the OAK 4 camera's that are coming out integrated with host and also supports sending signals thru Network/Ethernet? ( Possibly M12/M8 and UART options as well).

          Yes. It has M8+M12. For OAK4 we are developing M8 extensions that will expose things like CAN/UART/SPI/USB and such.

          Thanks,
          Jaka

          @jakaskerl

          Thank you for your prompt response and answer to my questions.

          Thank you for all your help and appreciate it!

          Have a great day and take care.

          Best regards,