- 3
- 103 515
Francisco Garcia
Приєднався 11 тра 2006
Horizontal Travel Picker Inspiration and Iterations
This is the evolution of the Horizontal Travel Robot Arm and the multiple phases that led me to the current build.
Learn more about how to replicate this robot at fdxlabs.com
Learn more about how to replicate this robot at fdxlabs.com
Переглядів: 891
Відео
Toy Picker Robot using Arduino and Rapsberry Pi
Переглядів 58 тис.5 років тому
Horizontal Travel Robot Arm demonstration with object detection and real objects. Learn more about how to replicate this robot at www.fdxlabs.com You can also read more about it here: medium.com/@pacogarcia3/computer-vision-pick-and-place-for-toys-using-raspberry-pi-and-arduino-68a04874c039
Lego Sorter with TensorFlow on Raspberry Pi (First Run)
Переглядів 45 тис.6 років тому
Read More about it here: medium.com/@pacogarcia3/tensorflow-on-raspbery-pi-lego-sorter-ab60019dcf32 Custom made Lego sorter using Raspberry Pi, OpenCV and Tensorflow with a retrained Inception V3 model. This first run had a total yield of 89% accurately sorted bricks: 98% separation efficiency and 90.8% classification accuracy. There is plenty of room to increase total yield across the mechanic...
what the code of programming this robot i need this
Have u done any additional work on a sorting machine?
Hi @pedrogarcia3, thanks for the great inspiration - after years now finally put together a machine as well ua-cam.com/video/FRHMMGDMjuQ/v-deo.html
Good evening, is this channel still alive?
Is it cheap enough to where you can make this robot arm and hand and make it be an Android Robotic Arm and Hand Chalkboard?
Hello.First of all thanks a lot for these great tutorials.I need help.I am doing object detection and I have 1 question.What if 2 objects are in same window.I mean 2 blue things are in same window. In which one will motors go? Can we do a filter for them for ex: go at the nearest one, wait x seconds and go to the second one.I asked these because i will burn detected objects and I need any filter.Can you help me? Thanks a lot.
Great
Which step would be changing if my frames do not match with yours?
Have you continued to use this machine or made improvements to it? There definitely needs to be an updated video to this (or additional article updates), preferably with more information on the details of its operation. I've read all your articles, but definitely want to know more.
^^^ Updates please! ^^^
i want code can you give me
Hanzhen harmonic drive gear , robot arm gear , automation joint gear , over 30 years experience ,
Could you share with me the technical design and software of this robot please ???
Where is the camera located?
Can i copy your code ?
Está bien hermoso... 😍
how to you match the robot frame with camera frame?
calibration before starting the picking. Define a ZERO spot in robot's working envelop and overlap it with the camera frame. Or ask the robot to visit the (0,0) spot and mark that on board. Then make sure that square is in frame at the right spot.
is there any way to contact you? I mailed you…no response… We are trying to replicate the project that you did but we have some doubt relating to it. 1: Is there any changes to be done on the code if we reduce the length of x axis from 1 mtr to 60 cm… 2: Can I use 15kg cm servo instead of 20 Kg cm servo…
it worked......thanks @ paco Garcia for making such an awsone project?..
@@jeffinsvarghese8907 I like to ask you some questions, can you help me. Can you leave me your email
Nicely done!!
Saludos Paco algun email donde pueda comunicarme contigo...? Gracias
Aquí: www.fdxlabs.com/contact-us/
Hello I would to know how to communicate rassberry pi with arduino to detect and take object !!!
nice work
nice job
soo cool
hello. I run main.py. And after a few sec, it go error with this messenge: SerialException: read failed: device reports readiness to read but returned no data (device disconnected or multiple access on port?) Is that the code error or my arduino broken. Could you help me? Thanks you.
I fix it. Thanks you.
@@nguyenquanghuy5577 hello bro .-., can i ask you some questions
@@ngochoapham1148 yeah?
hai did you make this project?
@@nguyenquanghuy5577 have you build this yet, can you help me with the dimension of the frame
how did you interface the Raspberry Pi with Arduino for *''sending the G-code for the servo motors'*'? how is the real-time sending of the G-code happening? I'm clueless at that part...it would be a big help, if you helped out by explaining that part of your project :):):)
Via the serial interface of Arduino. The raspberry pi send X,Y,Z coordinates and command and the calculations happen in the Arduino module
there is no "G-code", When you are working with servos, they are made to turn from 0 to 180 degrees. With variable resolution... so you only supply the degrees that the motor has to turn, Like 130.5 or 23 or 180. the Arduino function that is used to run a servo, the standard Library function takes argument for the angle to turn and the speed how fast you want it to be. So... NO G-Code.
Also as Paco said.. (I know its been a year but still If I'm relevant), the Pi sends the coordinate and the Arduino calculates the angles by Hard-Coded trigonometry. it basically calculates the angles of the arms and those are supplied to the respective servos.
Picker robot can be useful with farmbot.
Please Reply
Hi Pedro, super interesting! I'm trying to build something similar but not for Legos. Do you have more details regarding your conveyor belt? How did you build it? So far it's my most challenging part :-/ Thanks.
The conveyor is made with paper, and I used Con-Tact brand liner to strengthen it. The rollers are made from PVC, with the hubs 3d printer and a gt2 belt powering then from a DC motor
@@pacogarcia3 Ha smart! Thanks for the prompt reply. Con-Tact, paper motor belt and PVC are not an issue. The hubs however... do you know if they can be find anywhere? Or only option is to print them?
@@jean-marcspaggiari4798 I would say the hub and belt gear adapter for the PVC roller are 3d printed. The bearing hubs to hold the roller can be purchased. If you are US based lmk how to contact you. Files here: www.thingiverse.com/thing:3377239
@@pacogarcia3 Nice! I once added a single layer of packing tape to paper to give it ridiculous strength, I may try that with a paper conveyer now.
Please Reply
Hi Paco Please Reply , I need Some Serious Help
Hi Paco, I have found the new Camera Matrix, But I need to Know Ho you have caluculated the X_Center , Y_Center, Z_Center I understand U measured distance from the camera of lens to the point, Please Help for World Point manual Coordinates
These X and Y are described in the camera matrix. You need to locate that X,Y point manually in your image/real world, then measure Z at that point
@@pacogarcia3 so, Cx,& Cy , are the image pixels for Center right , and fx and fy, are X_Centre and Y_Center respectively , am i right ?
@@pacogarcia3 Sir Please reply How you have calculated world points for each points?
@@vjpanda I hope you got answer. if not I wish you should go through camera pinhole module to understand how image 2D image points are projected back in 3D world co-ordinates
@@anjank26 I got the answer thanks for asking
paco what is the payload of the robot?
Hello I would to know how to increase the capacity of the robot to handle like 1 - 2kg load. Can you help me?
It would require stronger motors or gears, as well as a reinforce arm structure. Would require significant change.
On a simpler note.. replace plastic with metal, and servo with bigger servos. Or at this point... Stepper motors offer WAYY higher torque than big servos at a better cost. so would need to replace servos with Steppers like Geared Nema-17 or bigger, and make changes to the arduino code to convert serial data to the respective G-code.
reply soon
Start here: inclass.kaggle.com/pacogarciam3/lego-set-object-recognition-example
@@pacogarcia3 thanks a lot sir but i want to know about my coordinate where image is located not for object detection
@@AjaySingh-le1og use this: www.fdxlabs.com/calculate-x-y-z-real-world-coordinates-from-a-single-camera-using-opencv/
provide me a code for finding coordiantes of a object in a live vedio cam for my capstone project
can i have file the 3d file
OK Paco.... I'm going to need some help here!!! I'm about to start building my own Lego sorter. I need to build a machine that will be able to handle approx 100lb of Legos per day. I'm actually thinking about building 3 different sorters. The 1st to sort by color, down to 15-20 colored bins. Then a 2nd sorter to take a full bin of a single color and break it down to brick types, maybe 10 different brick categories. Then each category of parts to be broken down to individual elements. I know I can build the mechanical side of the machines with no problem. But I am going to need advice and guidance on the software side !! I know very little about programming, but I am willing to learn !! I have also contacted Daniel West who has just finished his Lego sorter as well. It sounds like Daniel may be making his software open-source at some point. I need to know what to start buying... How good of a camera do I need.. what kind should I buy? What would be better, stepper or servo motors? What kind of optical sensors should I get ??
I'm in same boat as you
Hi, have you startet with the project yet? I guess you want to do this commercially? Greetings, Manuel
@@MCRuCr Yes, I have started my own machine. I have a BL store and we need to be able to process about 100 pounds per day.
@@BrickJunkies How is your progress coming, and where are you sourcing bricks from that you need to process 100lb a day? Seems like a lot of bulk bricks!
@@buddythedpg9141 It's coming along slow.. I have to learn to code, and I really don't want to, that that's not helping speed things along at all. I have a few "scouts" that bring them to me. I don't have to go hunting for bricks any more :)
which camera did you use
I used a single and standard Pi cam
Great work! Actually i am currently searching for a robotic arm for my thesis project with is a easte segregator, would this work?
Get in touch through my site fdxlabs.com I have a new version and I can help
Did you finish it…
This is cool. Can it be programmed to detect which way is foward on the object?
This is awesome. Do you think a ME that hasn't programmed since 2002 could tackle this build? I found your source code through Medium, and downloaded the tf library, but there is a lot to digest.
Do you still have the lego sorter build?
Hi Paco great work there, but does this work on picking up plants when they're finish harvesting ?
Of course!
Check out farmbot, it’s opensource
@@tedzbug07 did you do this project?
Now that it picks up things that are in align, how about when things are placed at random alignment?
Working on that. Currently building a larger version, and planning to add 90 degree rotation on the gripper... Stay tuned.
Wow amazing job can u share the code plz
Here you go github.com/pacogarcia3/hta0-horizontal-robot-arm/blob/master/README.md
You have 2 kits at www.fdxlabs.com/shop/ There are no prices. Why?
Good idea but in my opinion too slow :/
great project!
Hi, Thats really superb. Thanks so much for the great write up on Medium.com, It made me realize I might be able to build one of these even though I have no Python coding experience or Tensorflow knowledge (time to learn). I did get a PRUSA printer for a present so thats a start! I read that you may share the files for the printed parts, that would be great. Great work and a brilliant design. Thanks again for sharing.
Thank you! I'm working on a mechanical arm, that will be well documented and a much simpler mechanism for picking/sorting, stay tuned. That said, I’ve done an initial upload of the 3d printer parts for this sorter. Apologies that its a bit dis-organized, but never planned to share the build-out, as it was done very iteratively. Perhaps this can help with some portions of the design or even spark new ideas/solutions: www.thingiverse.com/thing:3377239
@@pacogarcia3 Followed your link. Wow! so much information on this project and broken down so that it is not so daunting.Looking forward to seeing the robot arm.Gotta get back to my Python books. Very inspiring. Thanks so much again.
Cool!