• RAE

  • Newbee: Quick Starter to get Code

Other notes for NewBees from the KickStarter campaign:

  • As of 14th Oct 2023 "RAE - Default app" is the only "Perception App" made for Rae - others appear to install but are for other devices and will not run - some need a soft/hard reset to recover Rae.
    Other Rae app may appear in the future though.
  • Gone are the days of messing around with DHCP and ip addresses, Rae is next level !
    When you plug the USB lead into a Windows 11 PC, Windows will automatically add in a new Ethernet port.
    This takes time and ssh will fail until fully installed.
    Progress can be followed from the:
    Windows Settings -> Network & internet -> Ethernet tab
    Then select the new port (unplug cable and replug in while on this page to find new Ethernet port), once found you can rename it to Rae. Clicking the new Ethernet connection will show Rae's IP address if all has gone well.
  • Using Putty the host name for Rae is root@192.168.197.55 to ssh (or Windows default ssh from command prompt)
  • For soft reset (effectively the same as hard reset without pressing the reset button AFAIK):
    SSH into Rae … then use:
    "rm -rf /data"
    "rm -rf /var"
    "rm -rf /etc"
    "reboot"
  • As of 14th Oct 2023, the Mobile app does not exist … yet 🙂

I hope this helps people get started.

For the first step (installing latest firmware) - could you provide a link for where to get it? I have been searching but been able to find any information on where to find firmware updates. The docs list the command to run but not where to find the link.

Upgrading Firmware

  1. SSH into Rae

  2. Change to home folder

cd ~

  1. Use wget to get the latest version (file with the newest date) from here:
    Official Releases: https://luxonisos.fra1.digitaloceanspaces.com/index.html?prefix=release/
    or
    Latest build: https://luxonisos.fra1.digitaloceanspaces.com/index.html?prefix=build/

    I used this at the time (Rae v1.13):

  1. Once downloaded install with:

mender -install [insert filename here]; reboot

EG:

mender -install luxonisos-rae-1.13.dm-verity.mender; reboot

I believe it should become an official guide on Luxonis website. Here's a video for the initial post. It took me some time to figure that out.

    7 days later

    Hi sskorol ,
    Thank you for the detailed steps, we will be updating our docs shortly (perhaps based off of it).
    Thanks again, Erik

    • Mike replied to this.

        erik … You are welcome 🙂

        Cheers,
        Mike.

          The instructions here assume that RAE even has an internet connection…

          I finally got mine working by connecting to my secondary network. My primary network has special chars in the SSID and I think the encoding in the QR code couldn't account for that. I am able to now log into the robot and load programs as shown in the video above!

          I am noticing though that my robot is drifting as it drives. Is there a native way to adjust the trim for the motors?

          21 days later

          Mike I don't get beyond step 3: I can't select anything in "Develop" (only for "Run")… Is 1.13 required? Still running 1.12, since apparently 1.13 is not yet released (and 1.12 gave me enough headaches so far…).

            When installing "Run", I can see the default app:

            When installing "Develop", i can't:

            (HelloRAE I created myself. Deleting it doesn't change anything (except that the window for "Develop" doesn't show any app then, obviously.)

              Hi DiMa
              It is meant to work that way. The App Store apps don't work in develop mode. The Default app will be made open source and enabled for developer mode, we just need to make some updates to the source code first.

              Thanks,
              Jaka

                I were referring to the first post in this thread - so the described procedure simply doesn't work (anymore) - correct?

                So how does one start to code on the rae? I can't find any examples, there are no instructions, there is basically no documentation - and even the app.py created by RH if you create a new app doesn't work on rae, because the methods used there simply don't exist in the robothub library shipped with rae.

                • Mike replied to this.

                  Hi @DiMa
                  Hm, you are right. Perhaps there was a develop mode available for some older version of the app and RH.
                  Try the examples from here.

                  Thanks,
                  Jaka

                    DiMa

                    Hello DiMa …

                    I just tried going through the process at the start of this thread again and it looks like things have changed … currently I can not see the Default Rae app in develop (lucky I took a clone of it). It looks like someone at Luxonis needs to tick a box to allow it to be used in develop mode.

                    Unfortunately I do not have time to go through it again … so will shelve Rae for another month … and wait for some updates and documentation to be released.

                    Rae has so much potential … but seems in dire need of simple back to basics … like move left … move right … from a simple python script … rather than nothing works and no docs.

                    My suggestion is to forget about RoboHub for the moment and try and get something running local on Rae.

                      jakaskerl Try the examples from here.

                      I'll give it a try…

                      But seriously: When will we get proper documentation?!

                          Hi DiMa
                          We are working on it, the docs should have more info/guides every day. Also make sure to look here, not the default docs page.

                          Thanks,
                          Jaka

                            Hi Jaka, I'm looking for the command guide for the call interface from the local front end to the RAE. These commands are the same as those being used in the button Local Front End of the RobotHub dashboard to send robot control and receive image packages. Can you share a link to that guide for me to work on while waiting for your release? Thanks.

                              Hi Philllip
                              There is the standard RobotHub FE API for communicating with your app from said app's frontend
                              there is nothing to install right now, its auto injected in your frontend when served from the frontend folder
                              this means it is rather difficult to use React/other frameworks, develop externally
                              but it's easy to use in plain Javascript (<script>) for very simple things
                              the documentation on this was pulled, as the API is changing right now, and new documentation is WIP - although that's going to require a new firmware to use, accompanying libraries will be released and more.

                              You can, however, still see it used in our luxonis/robothub-examplestree/main repository
                              as for replicating some of the functionality of the official app - some of the calls/features are internal and inaccessible to other apps right now as this app is being rewritten for public consumption at the moment.

                              Also you can't really write just frontend for the official RAE app - there is no way to connect to it
                              it must be the app's official frontend (placed as part of apps source) to connect to it.

                              Could you be a bit more specific about what you are trying to achieve?

                              Thanks,
                              Jaka

                              • Mike replied to this.

                                  Hi Jaka, I'm thinking that the available run mode only for the RAE default app and with local front-end control is working instead of manual. I'd like to create my remote app running either Java or Python to send the same API command interface method to RAE. For a simple autonomous RAE driving practice application, I can view the the video stream from a selected front or rear view to make the driving control decision to go along a straight or curve path and even to avoid an obstacle. This is what I want to achieve.

                                  Thanks,

                                  Phillip