Speaking Robot - Prototypes

 Overall:

  • Simulate the environment for child
  • Wait for the child to speak or babble
  • Develop speaking on top of what child says (in the right direction)

High Level Algorithm:

* Simulate the environment for child and the robot, and upload it to the robot

* Simulate the robot's memory based on past actions, surroundings and certain "principles" and upload it to the robot

* Now onwards ---

  • Robot has an idea of its own surroundings
  • Robot has an idea of the child's surroundings
  • Robot has an idea of the place where the child is located, relative to its surroundings
  • Robot hears the child's sound/babbling/words
  • Robot interprets them
  • Build's up a appropriate response based on the sound, current conversation history, surroundings, past actions and its principles

Create a prototype: 

  • With multiple objects on a flat surface, few are red objects, few are yellow objects and few are green objects
  • Create a child object
  • Create a robot object

Goal - 1 (Robot Instructs/Interacts with the Child): 

  • Child comes across a red object. The child stops and babbles "mummy see". The robot interprets the babbling. The robot instructs the child (verbally) to "come forward". The child does so. And moves forward from the red object.
  • Child comes across a red object. The child stops and babbles "mummy see". The robot interprets the babbling. The robot instructs the child (verbally) to "Push it aside". The child replies "Ok mummy". The child pushes the red object aside and moves forward.
Goal - 2 (Robot Instructs/Interacts with the Child): 
  • Child's room is un-organized. Robot asks the child "organize the room". The child starts organizing. Robot is watching it on and off by visiting the room. The organizing is going fine until the 2nd visit (The robot keeps track of the organization changes). In its 3rd visit, robot observes that the child has kept a "snacks box" on top of his "ipad". The robot asks the child "keep the snacks box" on the his small "dining table". The child does so. The robot also instructs the child "Never keep food or water near or on your ipad". Child says "Ok mummy". Robot leaves. The room looks "organized" to the robot now.

Comments

Post a Comment

Popular posts from this blog

आई बाबा

आई वडीलांचं आपल्या आयुष्यात खूप योगदान असल्याची समज मला आयुष्यात फार उशिरा आली ... जवळ जवळ वयाची पन्नाशी गाठल्यावर ... साधारणपणे मुलीच्या बाबतीत असं होत नाही ... सर्वसाधारणपणे मुली जास्त संवेदनशील असतात ... आणि आईवडिलांच्याच काय, परीवारातल्या सगळ्यांच्या योगदानाची आठवण ठेवतात ... त्यांना परतफेड करण्याची सुद्धा इच्छा असते ... आणि ती त्या प्रत्यक्षातही आणतात ... पण मी त्याला अपवाद आहे ... ही फार अभिमानाने सांगण्याची गोष्ट नाही ... अर्थातच ... आणि त्याच्या वर माझी आईपण शिक्कामोर्तब करते, की तू मुलगी नाही मुलगाच आहेस आमचा ... आईचे हे म्हणणे, भारतीय समाजातली पुरुषप्रधानता लक्षात घेता लोकांना कौतुक वाटण्याची शक्यता आहे ... पण तसा गैरसमज करून घेतला नाही तर बरं, कारण माझी आई हे बरेचसे रागावून म्हणते ...कौतुकाने नाही ... मी माझ्या वडिलांवर गेली आहे, असेही तिचे म्हणणे आहे ... पण परत कौतुक नाही, की वडिलांसारखी Engineer आहे ... फक्त वडिलांसारखी संतापते, असाच भाग आहे ... असो ... हे मी आईवर मजेशीर कौटुंबिक टीका म्हणून सांगितले ... त्यात फार काळजीचे कारण नाही ... पण विचार आला की माझ्या इथपर्यंतच्या आ...
Read more

Robotics Ideas

Robotic Cleaning - Observe the drain blockage from outside of the pipeline - Need to develop something like X-Ray machine. Which will monitor the drainages for any blockage from outside. There should not be any road digging required, to find the blockages in the underground pipelines. - Robot to clean small (1 foot wide) as well as big (10 meters wide) drainages from the blockages or garbage thrown into it - Water treatment plants wherever the water gets drained into sea or river - Garbage collection, categorization, recycling and disposal system across the countries - Robot to clean the existing garbage thrown in the river/sea - Cover any open drainages - Educate people over garbage collection, categorization, recycling and disposal system. May be in the schools. Project Description A robotic arm which is able to clean a wide (50m x 50m) dry area, with dry garbage A robotic arm which will pick up and segregate the below matter    Plastic bags         ...
Read more

Movement of the Robotic Arm

Image
Movement: 1. Keep a heap of dry garbage (a mix of plastic, paper and leaves) in a tray. The tray is rectangular and light grey in color. The tray is always kept at a specific position. Keep the tray in a closed environment  where the light source is from the left as well as from the right of the tray. The robotic arm is mounted such that it's left to right movement is parallel to the tray's longer edge.  2. Start from the top of the heap. The "heap top" can be calibrated to the left-of-larger-edge of the tray and height as high as the robotic arm can go up in the air. This larger edge of the tray is closer to the robotic arm.  3. Now start swiping the camera horizontally, parallel to the tray's larger edge which is closer to the robotic arm. While swiping pick and segregate the objects which are identified as "paper", "plastic" or "leaves".  The "identification" process is as follows. Keep swiping the arm and capture three p...
Read more