Hi @Brandon,

Yeah, that thing in Amazon looks good. 🙂
• Yes. I think that's small enough. But still efficient ; and
• I have a Logitech K375 Bluetooth keyboard. And it came with a USB dongle. I think just about the same size (can't find it now, though I remember) ...

And yes. Though I haven't used Unfolding Space yet. But I think it's really cool! 🙂
• I really think haptic feedback in this use case should be something explored more ; and
• I've experimented a little about this, i.e. Coordinating Peter Meijer'S vOICe (also known as SeeingWithSound) through distance data of central objects from a Devantech SRF10 ultrasonic ranger and an ERM vibrating disk connected to a GPIO microcontroller called DRV2605L from Texas Instruments, running in an RPi Zero, and also in an X86 SBC called Liva Q ...


Thanks. All looks good to me. :-) One thing we haven't made run yet is OCR. I think it's doable we just haven't done it yet. The default OpenVINI model is humungous for some reason, so will need some looking/iterating.

Thanks andredavidbrown ! Really like your work there. Super fun! Definitely we're excited to help out on all of this. So the System on Module (here) allows integrating the depth and AI capability into a custom formfactor easily.

And all the baseboards for it are opensource so are a great starting point for doing a custom formfactor:
https://github.com/luxonis/depthai-hardware

Hi @andredavidbrown,

Thanks so much for helping out! 🙂
• I along with my blind friends greatly, and sincerely, appreciate all the valuable help we can get to hit the ground running with this project!

Amazing work on WAAIV! 🙂
• The OCR and gesture recognition stuff here is sure to help blind users like myself, along with my deaf friends ; and
• I also hope you're interested in sharing your pre-trained models for these functions. 🙂

Yes please, kindly help us with the prototype case discussed here; and
I do hope you're also interested in supporting the concept custom PCB for the frontal frame of a 3D printed / plastic-molded eyeglasses. 🙂

Really exciting stuff here! 🙂

@MarxMelencio ,

We've made a mount system for the BW1097 (Raspberry Pi Compute Module Edition). It's on our Github now and open-source:
https://github.com/luxonis/depthai-hardware/tree/master/BW1097_DepthAI_Compute_Module/Mechanical


So it mounts to any GoPro adapter so you allows you to mount the BW1097 to any GoPro compatible mounting system. We like this kit here as it allows mounting to pretty much everything anyone could think of and it’s only $25.99.

  • Need to mount your BW1097 to a Tripod? Done.
  • Need to head mount your BW1097? Done.
  • Need to put your BW1097 on a telescoping pole? Done.
  • Need to chest-mount your BW1097? Done.
  • Need to suction-cup your BW1097 to a window? Done.
  • Need to wrist-mount your BW1097? Done.

Hi @Brandon,

Awesome stuff! 🙂 Thanks so much for this!
• Would I be able to order the mount along with the BW1097?
• I'd like to start coding and testing it! 🙂
• If yes, then how much should I prepare? I think the BW1097 is $399 plus $25 or so for shipping here to the Philippines, but how much for the mount, along with other components you might've added like the Bluetooth dongle and a LiPoly battery, if any? My purpose in asking is that I have to write a bunch of articles first for my client, so I can prepare it. 😃

Also, I'll get from Amazon in 10 days or so the GoPro accessory that you mentioned, once I order it.

Please advise. Thanks again! 🙂


Hi @MarxMelencio ,

Thanks. Yes, definitely. So you can buy the BW1097 here for $399 and the mount for it here for $19.99 here.

So also I just got off the phone with Intel about sponsoring a competition around good uses of this technology (and your use is a fantastic one... I at least can't think of a better one). So Intel are planning on sponsoring a competition where the top 15 best ideas submitted get a free development kit. Then there will be a period of at least a month for implementation, and from those 15 selected, those who make the most compelling thing will also win a cash prize.

So I don't know when this will launch... but this could be a fantastic way to not have to save up to buy it, but would require waiting a little bit.

Thoughts?

Thanks,
Brandon

Thanks so much, @Brandon!

Yes, the Intel competition sounds really cool! 🙂
• But I think in a week or less [ I write content quite fast 🙂 ], I'll be able to raise the money for the BW1097, the mount, the GoPro accessory and the Bluetooth USB dongle (or its equivalent since Amazon says the vendor doesn't deliver the dongle to the Philippines).
• Which I think would be good, since this gives me time to be well-prepared for the competition. 🙂

Oh also, I can't find the link in your post regarding the battery that you like. 🙂

Cheers! 🙂

    Awesome, thanks MarxMelencio !

    So yes since we're in the US probably some of the products we find are not source-able local to you. The key for the USB battery is that it needs to support 2A output. The Raspberry Pi + DepthAI together regularly pulls above 1A, so that's why the 2A output is needed (and these batteries either do 1 or 2, usually nothing in-between).

    So in this video you can here me describe what power the unit is using when running depthai with object detection:
    [https://photos.google.com/photo/AF1QipOCD1QiztgtxhBhVp3NurVXzTVW_RSHFh8BV215](https://photos.google.com/photo/AF1QipOCD1QiztgtxhBhVp3NurVXzTVW_RSHFh8BV215

    Hi @Brandon. Good morning! 🙂

    Regarding the Bluetooth USB dongle — I found in Amazon this tiny Bluetooth USB dongle. It ships to the Philippines. And supports Raspberry Pi. 🙂

    And as for battery — Here are promising options:

    1. I already have this PiJuice hat. I've tested this to work with RPi Zero W / WH and RPi 3 Model B+. So I believe it likely works with the RPi CM3+.
      • And what's good about this is it has an 1860 mAh rechargeable battery and outputs 2a. Plus, it allows coding something for warning the user when battery level drops to a configurable percentage. And to shutdown the RPi safely when it drops to an even lower percentage ; and
      • However, what I don't like about this is its price ($90 here in the Philippines). This could be restricting for some blind users. And I'm not quite fond of its footprint (a little on the chunkier side) ...

    2. I'll also be testing the PiSugar units below. I've already contacted the manufacturer to add the Philippines to their shipping destinations. Both have a much smaller footprint. The latest variant has a 5000 mAh battery (up to 6a output). While earlier variant's have 900 and 1200 mAh options, both up to 2.4a. And both variants also provide programmatic access to battery levels. The latest variant even comes with a tiny programmable button, which I think can be used to also provide user access to non-battery-related functions, i.e. Can likely be programmed for recognition options.
      • PiSugar2 Pro — Latest variant. Works with RPi 3B+. So I think this'll likely work with RPi CM3+. But it's currently out of stock, though hopefully they'll have units soon ; and
      • PiSugar2 — Earlier variant. Works with RPi Zero W / WH. So I think it might work with RPi CM3+. This variant is currently available ...

    3. Another option is this battery hat from Waveshare. I like its small footprint. And it has a battery holder for 14500 Li-ion. But I still need to check if it outputs 2a (though I believe it does).

    Really exciting stuff here! 🙂

    Hi @MarxMelencio ,

    So let me get back to you with more details on Monday, but want to mention that HATs don't work on the BW1097 because the Myriad X module (the DepthAI System on Module) has a tall heatsink that gets in the way.

    I think there are like extenders that would allow this to still work, but it would have to be very tall. So for now it might make the most sense to use a USB battery that could say go in your pocked and then connect up to power the system.

    Later I think we could make a mount that includes the battery as well, once we down-select one and have that shipped out. I think a mechanical engineer friend is willing to work on this for free.

    The PiJuice version looks interesting. (Correction, sorry - referenced the wrong one.)

    Thanks again and will circle back more on Monday.

    -Brandon

    Hi @Brandon,

    Thanks for these details. Oh, so I now think battery options are:

    1. The PiSugar2 and PiSugar2 Pro, since it connects to the back side of the GPIO pins ;
    2. Using a tiny USB 5v 2-3a powerbank like this River Rapid powerbank. But an issue here is monitoring low power levels to safely shutdown the RPi CM3+ ; and
    3. Soldering directly to the GPIO pins, so the hats can be placed somewhere else than on the top of the unit, like say somewhere in the straps of the GoPro accessory (though something needs to be done to ensure the wires don't get disconnected easily) ...

    Anyway, moving forward, a mount to house a battery pack would be really cool! 🙂

    I'll talk to you again on Monday! Have a great weekend! 🙂

    Hi @MarxMelencio ,

    Yes, great point. I didn't think about the battery monitoring part. Yes, you could use one of the GPIO-extender cables with one of the Pi HAT solutions probably. I think there are a variety available (here's one I found just quickly Googling: here).

    Thanks again,
    Brandon

    So that others can find this later, we are discussing OCR w/ DepthAI (the Raspberry Pi Compute Module Edition, here, specifically). We made a Github issue (here) to discuss it more easily w/ code and references to new branches/pull-requests/etc.

    Hi @andredavidbrown,

    This is really awesome! Thanks a lot!! 🙂

    I hope it would be fine if I take your offer once I build and test at least a very preliminary prototype. 🙂
    I was, thankfully, able to raise a little money for electronic components (managed to write a lot of content for my clients in the past several days 🙂 ) — So right now, I'm still waiting for the stuff I ordered; and

    Also, @Brandon was able to get approval for sending me the DepthAI Rpi CM3 unit even before Intel's competition starts! — Thanks again, Brandon!! 🙂
    QUOTE:
    From: Brandon
    Date: Fri, 29 May 2020 11:57:44 -0600
    Subject: I Got Approval!
    To: Marx

    Hi Marx,

    I got approval to get you your unit before the competition starts!

    So all I'd ask is that you pay for shipping of the unit. I have no idea
    what the lowest-cost shipping method is to your location.

    But if this sounds good to you we can do a discount code for you on our
    website so that the cost of the unit is $0.00 instead of $399.

    We're small so our shipping rates are terrible internationally... so I
    wouldn't be surprised if it's like $90 shipping still.

    Just let me know if this sounds good and I'll make a discount code for you
    so you can order it for $0.00 from our store and then pay for shipping only
    (also through the store).
    /QUOTE

    Also waiting for the following stuff, which'll arrive in the Florida-based warehouse of a shipping service that I use for products that don't ship here in the Philippines (many of these didn't, so I just ordered most of it this way):

    • RPi CM Mount — Brandon and his colleagues fabricated the mount (thanks again, @Brandon!);
    • GoPro accessory;
    • Flick Zero (3D tracking / gesture detection Rpi HAT);
    • 40-pin GPIO extender ribbon cable (male to female);
    • Zero2Go Omini (power management board RPi HAT, supports 3 input types, including USB powerbank);
    • Anker PowerCore II 6700 mAh Powerbank (quite small, and 5v, 2a, USB output);
    • LOTEKOO 150Mbps USB WiFi Adapter (got this because it's really tiny);
    • Plugable USB Bluetooth 4.0 Low Energy Micro Adapter (also tiny);
    • Impact Last Bluetooth Audio Glasses (my wife and kid say it looks decent 🙂 ); and
    • Strong (or so it says in their Amazon page) Double-Sided Tape, among a few small things like magnetic clasps and a dog-tag ball chain (thinking of testing out a possible strap-on concept without the GoPro accessory) ...

    Again, @andredavidbrown — Thanks a lot for this really cool offer!!! 🙂


    Hi @Brandon and @andredavidbrown,

    While waiting for all electronic components to arrive here, I've been talking to Gilad of Bago Studio in Israel.
    And here's my recent email to him:

    Start of Email

    Hi Gilad,

    Thanks for your email!

    I greatly appreciate your interest in the project; and
    Thank you for the offer of a slightly more inexpensive price for your services!

    Yes, 3D printing would be more accessible, ubiquitous and inexpensive for end users.
    But I tried it out, and got a prototype that easily breaks, quite bulky, and very difficult to assemble.
    So I’m assuming others without significant 3D printing experience or high-end equipment, would likely run into the same problems, especially blind users like myself.
    So instead, I was thinking a small factory here or overseas can perhaps be asked to manufacture a plastic injection mold, and they can produce small batches of units as I get orders from my contact organizations that look after the welfare of blind and visually impaired persons here and overseas.

    Anyway, please kindly allow me to go through each of your comments.
    — Warning: Long Email!

    A. Electronic Hardware Requirements

    1. DepthAI Board, Cameras & SBC (Single Board Computer)

    • Yes. Just like the RPi SBCs, the design files of DepthAI board and cameras are all open;
    • All hardware design files of the DepthAI module is found here;
    • Meanwhile, this is DepthAI’s product page; and
    • As you’ll see in that page, DepthAI has the following 3 editions:

    a) DepthAI RPi Compute Module Edition
    — This is the DepthAI board, mounted unto the RPi CM3+; and
    — On top of the DepthAI board are the 2 left-and-right grayscale cameras and the center color camera.

    b) DepthAI USB3 Onboard Camera Edition
    — This is the same thing. Minus the RPi CM3+; and
    — This is for connecting it to any host computer like an RPi Zero WH or Intel’s Compute Stick, or anything with an OS that can run OpenVINO.

    c) DepthAI USB3 FFC Edition
    — This is the DepthAI board with MIPI-CSI2 ports for the cameras; and
    — The cameras can be ordered separately. 12cm FFCs would probably be available at the moment.

    1. 3D Tracking & Gesture Control Board

    • This is the Flick Zero board. It’s product page can be found here;
    • This is to perform gestures for issuing commands, i.e. Select and activate / deactivate options, etc.;
    • This board has small dimensions and a 40-pin GPIO interface; and
    • This can be connected to the SBC through a 40-pin flat ribbon cable (female to male), similar to this one here (though much longer).

    1. Battery & Power Management Board

    • A good option for a power management board is the Zero2Go Omini;
    — It supports 3 types of batteries, including a USB powerbank;
    • As for a battery, a good option is the Anker PowerCore2 6700 mAh powerbank;
    — It’s a really small USB powerbank;
    • Another option for a battery and power management board combo is the PiSugar2 Pro;
    — It’s connected at the bottom of a compatible SBC like the RPi SBCs;
    — But it’s currently out of stock; and
    • Eitherway, the objective is to provide 5v 2a power that can be monitored and programmatically controlled.

    1. USB WiFi & Bluetooth Dongles (Optional, Depending on SBC)

    • If the RPi CM3+ is used, then a WiFi dongle as well as a Bluetooth dongle are needed;
    — These are options for tiny compatible WiFi dongle and Bluetooth dongle; and
    • But if an RPi Zero WH is used, then these dongles won’t be necessary as this SBC has them built in.

    1. Bluetooth Audio Output Device

    • I’m thinking a pair of these Bluetooth open ear audio eyeglasses would be a good option for this;
    • There are others like these here, so this’ll depend on the user; and
    • The user can even opt to get just a Bluetooth headset or earbuds.

    B. Mount / Case & Product Design Ideas

    I. Minimalist Approach

    • 1st Case
    — Small, slim case for the DepthAI USB3 Onboard camera edition and the Flick Zero gesture board;
    — The length of the DepthAI board is really close to the length of the gesture control board;
    — The width of these boards are also quite similar;
    — They can be aligned length-wise;
    — So the case’s width including walls would just be a little bit wider than these boards’ combined widths; and
    — Magnetic clips built at the back of this case, so it can be attached to the user’s shirt (front neckline).

    • 2nd Case
    — Another small, slim case for the SBC, battery and power management board;
    — Magnetic clips built at the back of this case, so users can clip it to their trouser’s belt straps; and
    — Openings for SBC’s power on / off and reset buttons, HDMI and USB ports, among others (depending on the SBC).

    • Connector Cable
    — 40-pin flat ribbon connector from Flick Zero gesture board to SBC, combined with wire connectors from DepthAI board to SBC; and
    — Insulated cover to combine these as one thin cable.

    ** Advantages
    • Users can choose any Bluetooth audio output device that they prefer;
    • Quicker and simpler to assemble, fabricate and optimize for a production version; and
    • Can be more inexpensive to produce, so also cheaper for end users.

    ** Disadvantages
    • Users need to tilt their bodies, instead of just their heads;
    • As a completely blind person myself, I believe there are certain instances, though just a few, where doing this would be a bit unnatural; and
    • Nevertheless, a little getting used to wearing and using this would definitely help.

    II. Difficult Approach

    • 1st Case
    — A custom PCB needs to be designed to hold all 3 cameras;
    — This should be designed in a way that can be integrated into the frame of a pair of eyeglasses;
    — Left and right cameras situated at the ends of the front frame;
    — Center camera at the center (nose bridge area of the frame);
    — Hollow frame where FFC cables will be inserted;
    — Tiny Bluetooth TWS (true wireless stereo) boards, tiny speakers with a tiny battery need to be integrated into each arm of the eyeglasses;
    — These also need to be designed following modern open ear directional sound output specifications; and
    — 3D printed or plastic injection molded frames should look like an ordinary pair of sports sunglasses (modern ordinary sports sunglasses are already thicker than others).

    • 2nd Case
    — A small, slim case for the DepthAI board, SBC, battery and power management board;
    — Magnetic clips built at the back of this case;
    — Cable connectors should be extra long, in order for users to attach the case to the belt holders of their trousers; and
    — Openings for SBC’s power on / off and reset buttons, HDMI and USB ports, among others (depending on the SBC).

    • Connector from 1st Case to 2nd Case
    — Camera FFC connectors going out the ends of both arms of 1st case (eyeglasses frame) will meet at a certain point, in order to be combined as one thin insulated cable;
    — This thin insulated cable will then be connected to the 2nd case; and
    — While the user’s moving around, this unified insulated cable should be thin enough, in order to prevent the 1st case from moving too much.

    • Ring Case for Tiny Bluetooth Button to Replace Gesture Control Board
    — A tiny case shaped like a ring for the user’s finger; and
    — This is for issuing commands to the device, i.e. Go through options, activate / deactivate, etc.

    ** Advantages
    • Users can move their heads in more natural ways when trying to detect and recognize objects, read text, etc.

    ** Disadvantages
    • Is not at all simple to produce, fabricate and optimize;
    • Can be quite time-consuming and expensive to design and produce; and
    • Would also likely be more expensive and difficult to assemble for end users.

    Well, these are my ideas.
    I’d greatly appreciate your comments.
    Thanks again for your time and interest in helping me out!

    Best Regards,
    Marx

    End of Email

    I'm now waiting for Gilad's response.

    Thoughts? Thanks for your time! 🙂


    I had audio issues with using pi zero with the google aiy projects vision board with movidius. the pi zero did no support audio over bluetooth at the time.