Hi @Brandon,

Thanks for these details. Oh, so I now think battery options are:

  1. The PiSugar2 and PiSugar2 Pro, since it connects to the back side of the GPIO pins ;
  2. Using a tiny USB 5v 2-3a powerbank like this River Rapid powerbank. But an issue here is monitoring low power levels to safely shutdown the RPi CM3+ ; and
  3. Soldering directly to the GPIO pins, so the hats can be placed somewhere else than on the top of the unit, like say somewhere in the straps of the GoPro accessory (though something needs to be done to ensure the wires don't get disconnected easily) ...

Anyway, moving forward, a mount to house a battery pack would be really cool! 🙂

I'll talk to you again on Monday! Have a great weekend! 🙂

Hi @MarxMelencio ,

Yes, great point. I didn't think about the battery monitoring part. Yes, you could use one of the GPIO-extender cables with one of the Pi HAT solutions probably. I think there are a variety available (here's one I found just quickly Googling: here).

Thanks again,
Brandon

So that others can find this later, we are discussing OCR w/ DepthAI (the Raspberry Pi Compute Module Edition, here, specifically). We made a Github issue (here) to discuss it more easily w/ code and references to new branches/pull-requests/etc.

Hi @andredavidbrown,

This is really awesome! Thanks a lot!! 🙂

I hope it would be fine if I take your offer once I build and test at least a very preliminary prototype. 🙂
I was, thankfully, able to raise a little money for electronic components (managed to write a lot of content for my clients in the past several days 🙂 ) — So right now, I'm still waiting for the stuff I ordered; and

Also, @Brandon was able to get approval for sending me the DepthAI Rpi CM3 unit even before Intel's competition starts! — Thanks again, Brandon!! 🙂
QUOTE:
From: Brandon
Date: Fri, 29 May 2020 11:57:44 -0600
Subject: I Got Approval!
To: Marx

Hi Marx,

I got approval to get you your unit before the competition starts!

So all I'd ask is that you pay for shipping of the unit. I have no idea
what the lowest-cost shipping method is to your location.

But if this sounds good to you we can do a discount code for you on our
website so that the cost of the unit is $0.00 instead of $399.

We're small so our shipping rates are terrible internationally... so I
wouldn't be surprised if it's like $90 shipping still.

Just let me know if this sounds good and I'll make a discount code for you
so you can order it for $0.00 from our store and then pay for shipping only
(also through the store).
/QUOTE

Also waiting for the following stuff, which'll arrive in the Florida-based warehouse of a shipping service that I use for products that don't ship here in the Philippines (many of these didn't, so I just ordered most of it this way):

RPi CM Mount — Brandon and his colleagues fabricated the mount (thanks again, @Brandon!);
GoPro accessory;
Flick Zero (3D tracking / gesture detection Rpi HAT);
40-pin GPIO extender ribbon cable (male to female);
Zero2Go Omini (power management board RPi HAT, supports 3 input types, including USB powerbank);
Anker PowerCore II 6700 mAh Powerbank (quite small, and 5v, 2a, USB output);
LOTEKOO 150Mbps USB WiFi Adapter (got this because it's really tiny);
Plugable USB Bluetooth 4.0 Low Energy Micro Adapter (also tiny);
Impact Last Bluetooth Audio Glasses (my wife and kid say it looks decent 🙂 ); and
Strong (or so it says in their Amazon page) Double-Sided Tape, among a few small things like magnetic clasps and a dog-tag ball chain (thinking of testing out a possible strap-on concept without the GoPro accessory) ...

Again, @andredavidbrown — Thanks a lot for this really cool offer!!! 🙂


Hi @Brandon and @andredavidbrown,

While waiting for all electronic components to arrive here, I've been talking to Gilad of Bago Studio in Israel.
And here's my recent email to him:

Start of Email

Hi Gilad,

Thanks for your email!

I greatly appreciate your interest in the project; and
Thank you for the offer of a slightly more inexpensive price for your services!

Yes, 3D printing would be more accessible, ubiquitous and inexpensive for end users.
But I tried it out, and got a prototype that easily breaks, quite bulky, and very difficult to assemble.
So I’m assuming others without significant 3D printing experience or high-end equipment, would likely run into the same problems, especially blind users like myself.
So instead, I was thinking a small factory here or overseas can perhaps be asked to manufacture a plastic injection mold, and they can produce small batches of units as I get orders from my contact organizations that look after the welfare of blind and visually impaired persons here and overseas.

Anyway, please kindly allow me to go through each of your comments.
— Warning: Long Email!

A. Electronic Hardware Requirements

  1. DepthAI Board, Cameras & SBC (Single Board Computer)

• Yes. Just like the RPi SBCs, the design files of DepthAI board and cameras are all open;
• All hardware design files of the DepthAI module is found here;
• Meanwhile, this is DepthAI’s product page; and
• As you’ll see in that page, DepthAI has the following 3 editions:

a) DepthAI RPi Compute Module Edition
— This is the DepthAI board, mounted unto the RPi CM3+; and
— On top of the DepthAI board are the 2 left-and-right grayscale cameras and the center color camera.

b) DepthAI USB3 Onboard Camera Edition
— This is the same thing. Minus the RPi CM3+; and
— This is for connecting it to any host computer like an RPi Zero WH or Intel’s Compute Stick, or anything with an OS that can run OpenVINO.

c) DepthAI USB3 FFC Edition
— This is the DepthAI board with MIPI-CSI2 ports for the cameras; and
— The cameras can be ordered separately. 12cm FFCs would probably be available at the moment.

  1. 3D Tracking & Gesture Control Board

• This is the Flick Zero board. It’s product page can be found here;
• This is to perform gestures for issuing commands, i.e. Select and activate / deactivate options, etc.;
• This board has small dimensions and a 40-pin GPIO interface; and
• This can be connected to the SBC through a 40-pin flat ribbon cable (female to male), similar to this one here (though much longer).

  1. Battery & Power Management Board

• A good option for a power management board is the Zero2Go Omini;
— It supports 3 types of batteries, including a USB powerbank;
• As for a battery, a good option is the Anker PowerCore2 6700 mAh powerbank;
— It’s a really small USB powerbank;
• Another option for a battery and power management board combo is the PiSugar2 Pro;
— It’s connected at the bottom of a compatible SBC like the RPi SBCs;
— But it’s currently out of stock; and
• Eitherway, the objective is to provide 5v 2a power that can be monitored and programmatically controlled.

  1. USB WiFi & Bluetooth Dongles (Optional, Depending on SBC)

• If the RPi CM3+ is used, then a WiFi dongle as well as a Bluetooth dongle are needed;
— These are options for tiny compatible WiFi dongle and Bluetooth dongle; and
• But if an RPi Zero WH is used, then these dongles won’t be necessary as this SBC has them built in.

  1. Bluetooth Audio Output Device

• I’m thinking a pair of these Bluetooth open ear audio eyeglasses would be a good option for this;
• There are others like these here, so this’ll depend on the user; and
• The user can even opt to get just a Bluetooth headset or earbuds.

B. Mount / Case & Product Design Ideas

I. Minimalist Approach

• 1st Case
— Small, slim case for the DepthAI USB3 Onboard camera edition and the Flick Zero gesture board;
— The length of the DepthAI board is really close to the length of the gesture control board;
— The width of these boards are also quite similar;
— They can be aligned length-wise;
— So the case’s width including walls would just be a little bit wider than these boards’ combined widths; and
— Magnetic clips built at the back of this case, so it can be attached to the user’s shirt (front neckline).

• 2nd Case
— Another small, slim case for the SBC, battery and power management board;
— Magnetic clips built at the back of this case, so users can clip it to their trouser’s belt straps; and
— Openings for SBC’s power on / off and reset buttons, HDMI and USB ports, among others (depending on the SBC).

• Connector Cable
— 40-pin flat ribbon connector from Flick Zero gesture board to SBC, combined with wire connectors from DepthAI board to SBC; and
— Insulated cover to combine these as one thin cable.

** Advantages
• Users can choose any Bluetooth audio output device that they prefer;
• Quicker and simpler to assemble, fabricate and optimize for a production version; and
• Can be more inexpensive to produce, so also cheaper for end users.

** Disadvantages
• Users need to tilt their bodies, instead of just their heads;
• As a completely blind person myself, I believe there are certain instances, though just a few, where doing this would be a bit unnatural; and
• Nevertheless, a little getting used to wearing and using this would definitely help.

II. Difficult Approach

• 1st Case
— A custom PCB needs to be designed to hold all 3 cameras;
— This should be designed in a way that can be integrated into the frame of a pair of eyeglasses;
— Left and right cameras situated at the ends of the front frame;
— Center camera at the center (nose bridge area of the frame);
— Hollow frame where FFC cables will be inserted;
— Tiny Bluetooth TWS (true wireless stereo) boards, tiny speakers with a tiny battery need to be integrated into each arm of the eyeglasses;
— These also need to be designed following modern open ear directional sound output specifications; and
— 3D printed or plastic injection molded frames should look like an ordinary pair of sports sunglasses (modern ordinary sports sunglasses are already thicker than others).

• 2nd Case
— A small, slim case for the DepthAI board, SBC, battery and power management board;
— Magnetic clips built at the back of this case;
— Cable connectors should be extra long, in order for users to attach the case to the belt holders of their trousers; and
— Openings for SBC’s power on / off and reset buttons, HDMI and USB ports, among others (depending on the SBC).

• Connector from 1st Case to 2nd Case
— Camera FFC connectors going out the ends of both arms of 1st case (eyeglasses frame) will meet at a certain point, in order to be combined as one thin insulated cable;
— This thin insulated cable will then be connected to the 2nd case; and
— While the user’s moving around, this unified insulated cable should be thin enough, in order to prevent the 1st case from moving too much.

• Ring Case for Tiny Bluetooth Button to Replace Gesture Control Board
— A tiny case shaped like a ring for the user’s finger; and
— This is for issuing commands to the device, i.e. Go through options, activate / deactivate, etc.

** Advantages
• Users can move their heads in more natural ways when trying to detect and recognize objects, read text, etc.

** Disadvantages
• Is not at all simple to produce, fabricate and optimize;
• Can be quite time-consuming and expensive to design and produce; and
• Would also likely be more expensive and difficult to assemble for end users.

Well, these are my ideas.
I’d greatly appreciate your comments.
Thanks again for your time and interest in helping me out!

Best Regards,
Marx

End of Email

I'm now waiting for Gilad's response.

Thoughts? Thanks for your time! 🙂


I had audio issues with using pi zero with the google aiy projects vision board with movidius. the pi zero did no support audio over bluetooth at the time.

Good to know on the Pi Zero bluetooth @andredavidbrown , thanks.

And great options/ideas here @MarxMelencio . Super thorough.

I'm leaning towards the hard approach. I'd love to do this:

  1. Start with an industrial design that is ideal for the user experience for someone who is visually impaired.
  2. Iterate on its feasibility to implement based on the DepthAI System on Module (which is 30mmx40mm), while allowing the PCB design around that to change however needed.
  3. Down-select to an Industrial Design which is optimized for this great UX while allowing the SoM to fit realistically, and use this design to then do a custom board layout around the system on module.

So this would require someone to take the carrier board designed that we've open-sourced and make them into this form-factor. But it's not a huge project, so maybe we can either find someone to sponsor the work by donating their time for free (I would donate mine, but I'm already working 14 hour days and I'm still not responding to each days emails/etc.). I may have a friend or two who would be interested in doing this though. I'll ask around.

This would all hinge though on figuring out this ideal industrial design first (with constraints on what the electronics can realistically be, including thermal is properly handled). The doing the re-layout from that.

Will circle back if I get any takers. :-)

Sweet thanks @andredavidbrown !

So to get going on this I'm thinking if it would make sense to do a dedicated live text-chat for development purposes.

We have our Luxonis Community that we could use and we could make a dedicated channel in there where anyone who is interested can join. I'll go ahead and do that now. (But it's easy to undo, so if there's a preferred alternative I'm 100% open to that as well.)

Here's the invite link:
https://join.slack.com/t/luxonis-community/shared_invite/zt-emg3tas3-C_Q38TI5nZbKUazZdxwvXw

Thoughts?

Thanks,
Brandon

Just made the #visual-assistance channel in the Luxonins-Community slack above. You both should be able to join the slack with that invite link and then in #general I dropped the link to #visual-assitance (or CMD-K / CTRL-K to switch to it w/in slack).

Hi @Brandon and @andredavidbrown,

Thanks! 🙂
Also, here's my most recent email discussion with Gilad:

Start of Email

Hi Gilad. Thanks for your email! 🙂

First, really good to know about SLA / SLS 3D printing.
I think it'll be the better option, especially for the minimalist approach that I described in my previous email ...

Second, regarding 3D files:

• Only the 3 DepthAI editions, their 3 cameras and the Raspberry Pi boards have open 3D design files;
• In my previous email, I provided the link to DepthAI's Github repo with the design files for the DepthAI boards (3 editions) and their 3 cameras;
• However, the other components like the Flick Zero board, the WiFi and Bluetooth dongles, the Zero2Go Omini power management board, the Anker PowerCore2 powerbank, the Bluetooth open ear audio eyeglasses and others do not have open 3D design files; and
• That's because these components are commercial products ...

Third, I think what we can do for now is design a prototype SIMILAR to the cases for the minimalist approach.
This way, we can use the components as they are, and just design / fabricate the cases.
This'll allow us to develop a working prototype much faster, and less costly.
We can then use this as a proof of concept prototype, which we can then use to generate funding interest from organizations like government agencies and commercial groups ...

Fourth, I attached a couple of images.
This is just in order for me to describe the prototype that I'm envisioning.
And please allow me to describe this prototype in more detail here:

A. 1st Case

This is what I want to describe through the object that I used in the attached images.
** Of course, it'll be much smaller and much slimmer than this, as I can't find something here that's close to the dimensions (l x w x h) of the Flick Zero board ...

  1. As you can see in the "open_clamp_case" image below:

• This has 2 panels; and
• One panel faces outwards, while the other panel inwards ...

  1. Meanwhile, as you can see in the "closed_clamp_case" image below:

• It's clamped shut, which securely attaches it to the front neckline of my t-shirt; and
• One panel is facing outwards, while the other panel facing inwards ...

  1. Still in the "closed_clamp_case" image below:

• I imagine the 3 cameras placed on the top row of the outwards-facing panel, from left to right;
• Facing the image, this means left camera is at the right, center camera at the center, and right camera at the left of this row; and
• Meanwhile, the bottom row (left to right) is the gesture control board's sensor input panel ...

  1. Still in the "closed_clamp_case" image below:

• The inwards-facing panel is just a solid panel with magnetic areas, and also a hollow area in its center just for the cables to go through;
• These cables are the FFC connectors of the 3 cameras (3 FFC connectors), along with the gesture control board's 40-pin ribbon cable; and
• Once it's clamped shut, the magnetic areas along with the case's locking hinges will securely fasten it to the front neckline of the user's shirt;
• The cables will be combined into a thin unified cable, which will start from the bottom of the inwards-facing panel (going down through the inside of the user's shirt);
• The other end of this cable is connected to the 2nd case; and
• The 2nd case will be in the user's pocket, or latched to the user's belt, or clipped to the belt holder of the user's trousers ...

** Note: I intend to use this FFC extender ; and
*** I'm thinking of also using a USB3-C to USB3-A adapter as I think the DepthAI USB3 FFC edition board is connected to the host SBC via USB3-C, and all RPi SBCs aside from RPi4 don't have a USB3-C port ...

B. 2nd Case

  1. This will contain the DepthAI board (USB3 FFC edition), the single board computer, the power management board, and the powerbank;

  2. The DepthAI board will be connected via a USB3-C to USB3-A cable to the single board computer (thinking RPi 3B+);

  3. The power management board will also be connected to the single board computer's 40-pin GPIO, and the full 40-pin GPIO will still be available (this power management board's GPIO connector is designed this way;

  4. Meanwhile, the FFC cables will be connected to the DepthAI board, and the 40-pin flat ribbon cable will be connected to the single board computer's 40-pin GPIO;

  5. This case should be as small and slim as possible;

  6. This should have holes for efficient ventilation, and also for the single board computer's ports, power and reset buttons; and

  7. The backside of this case will have either magnetic clips, similar to the wide clips of small pocket knives that can be latched to the hem of the user's pocket, or clasps similar to key rings ...

I believe this in itself is already a decent prototype.
What do you think?
Please advise. Thanks for your time and valuable expertise! 🙂

Best Regards,
Marx

#End of Email#

Would greatly appreciate your comments about this at your most convenient time, @Brandon and @andredavidbrown — Thanks! 🙂

Hi again @Brandon and @andredavidbrown,

Just want to ask about your experience in using FFC extenders such as these (just want to know if this would likely work with the 3 cameras) ; and

@Brandon, I'd also want to confirm if DepthAI USB3 FFC edition is connected to the host computer via USB3-C?
And if so, do you think a USB3-C to USB3-A adapter / cable (male to male) such as this would likely work with DepthAI USB3 FFC and an RPi board like 3B+?

Please advise. Thanks for your time, expertise, and patience! 🙂

I have used extension cables on both iPhone cameras and raspi based prototypes but I think there is an upper limit on length before you get issues. I think you can get boosters as well and then run another cable

Great questions!

Yes, the FFC extenders seem to work well. We have only tested a little on DepthAI, but we tested the grayscale cameras to work with 24" FFC and they worked w/out a problem. The color DepthAI camera (IMX378) we haven't happened to test with longer FFC, but we have tested the Pi HQ camera (IMX477) with a total of what looks like to be 24" of cable, and it worked fine. The image below shows this working with 24" of FFC cable on our bench:

WRT the USB3-C to USB-3A adapter / cable - yes, that will work. In fact we were doing FCC/CE testing of DepthAI today (it passed!) and we were using effectively that same cable, but with a Pi 4 (as the host for the test).

And I'll circle back on the ID concept tomorrow (late here) but from what I'm seeing, there's quite interesting ideas there!

Hi @MarxMelencio ,

Sorry about the delay I just got to reading your ID email with good attention to fully absorb it. So I like the idea. I have a proposal on how to make it cleaner:

The "DepthAI: USB3C with Onboard Cameras" version may actually work better for this sort of enclosure technique. So when running this version off of a Raspberry Pi, it can be changed to do both power and data over USB only. So no power cable.

So this device is shaped like a weird "T". So the top of the T is 100mm across, the T is 46mm tall, and the base of the T is 42mm.

So this device could be in the 1st Case and then have just a single USB cable going to the second case that is in the users pocket or belt.

That way it's cleaner than having multiple FFC cables going down there.

That said, the BW1097 you ordered may be the cleanest, as it has the Pi integrated directly onto it, so the who think could chest-mount. I guess this will be a lot lighter on the chest, so it can mount on the shirt like you mention. So that does make sense.

With this sort of setup you could also wrist-mount it too if that's of interest.

Thoughts?

Thanks,
Brandon

Hi @Brandon,

Yes. Thanks for directing my attention to the "DepthAI: USB3C with Onboard Cameras".
I think this is likely a much better solution!
But just a quick question though - What's the height / thickness of this board?

I'll also be testing the DepthAI RPi CM3+ edition as soon as it arrives here - Hopefully, this'll arrive today or tomorrow.
But I think another separate enclosure for the battery is still needed with this setup.
That's because it'd probably be a bit on the heavy side when the battery and Zero2Go power management board are attached to the DepthAI RPi CM3+.
And this is why I was thinking of the DepthAI USB-C FCC edition.

Though because of your suggestions - My attention for this alternative approach is now on the DepthAI USB3-C onboard edition! 🙂
Another good thing about this is that it's still USB3-C, so the cable would most likely be thin - For this ID concept, I think combining this cable with the 40-pin flat ribbon cable of the gesture control board (Flick Zero) wouldn't significantly affect its flexibility.
Plus, it'll be more straightforward to also use other single board computers that support USB3-C and OpenVINO.

Thanks again! 🙂

Hi @MarxMelencio ,

The thickness is 27mm (mainly the heatsink). So if put in a metal case one could heatsink to that directly so that it wouldn't be as thick.

And yes sounds right on everything else you mention.

So one thing that might be possible is to just have the battery down w/ the SBC and have it monitor the battery directly there. So then the only thing that is on the chest is the BW1098OBC connected over USB. Note that the BW1098OBC is set up to have 5V barrel power, but there's a resistor that can be switched to make it power over USB instead.

We did this because by spec USB2 devices can only supply 500mA. And the board can pull as much as 900mA. So USB3 is enough (it's rated for 900mA), but we can't control if folks plug into a device that can supply only 500mA.

FWIW, most SBCs can do over 900mA (usually like 2A) through their USB ports, even USB2. The Raspberry Pi 3B+ can do about 2A for example.

Thoughts?

Thanks,
Brandon

    So we were talking to one of our customers about this and he brought up this system:

    It uses servos to tap you on the temple to tell you to go left or right on a path.

    Hi Brandon,

    Really cool idea to take out the BW1098OBC's heatsink and integrate that into the ID of the enclosure!! 🙂
    —> I'm thinking of placing a thinner H-shaped heatsink in the original heatsink's place, so it'll be built into the enclosure's front and sides; and
    • This'd likely make the entire thing thinner, also most likely without negatively affecting the heatsink's efficiency in serving its purpose ...

    Also, would it be possible for me to order a BW1098OBC that's already switched to use USB3-C power and has the heatsink taken out?
    —> I'd probably be able to afford this, including shipping, by next week ...

    And I'm still waiting for the DepthAI RPi edition to arrive — DHL tracking seems to be stuck at "customs event", but I've already contacted them about this a couple of times (still waiting for them to get back to me) ...

    On another note, I've been talking to 45 blind users here for the past 2 weeks — I introduced the concept to them, and all of them are really, really excited about this! 🙂
    —> I developed and been conducting, as the main trainer, a series of free Webinar training sessions in coordination with Resources for the Blind, Inc. here in the Philippines; and
    • It's called "Remote Work 101 — An Actionable Workshop to Get Gainful Online Jobs in the Middle of a Global Crisis ", which is sponsored by Nippon Foundation Japan and ICEVI East-Asia (International Council for the Education of Persons with Visual Impairment) ...

    • 🙁 Almost 70% of blind Filipino adults here in the country recently lost their ONLY income source. That's due to gov't mandated lockdowns as a response to CoViD-19, as they're masseurs; and
    • 🙁 Blind Filipino children and teenagers alike are also significantly affected, as they aren't getting suitable education due to the lockdowns, especially in rural areas here ...

    So I learned that, both in urban and rural areas here, many with 30% vision are riding their bikes while others without functional eyesight are walking for an hour or so each day (still no public mass transport due to the lockdowns), just to go to downtown areas, so as to access gov't support services and Internet connectivity for these free Webinars / remote training sessions, among their other day-to-day needs. 🙁
    • This is where DepthAI can really, really help; and
    • I've also been talking to SPED teachers about the possibility of using DepthAI to provide gammified educational content to blind Filipino children and teenagers even beyond these lockdowns, and they're really, really hopeful! 🙂