This site is only a doorway

Everything here is gathered from things other people actually researched, thought through, and built: books, papers, historical records, and the people behind them. If something here catches your interest, go look at the original sources listed at the bottom of the page. They carry more depth than a page like this ever can.

Why Do Convenience Store Robots Still Need Humans to Help Them?

Category: Technology

In August 2020, a test began at a FamilyMart store in Toshima Ward, Tokyo. A robot started arranging bottled drinks on shelves. But the robot was not working alone. It was being controlled by a person in an office far away, using VR equipment [1].

We often hear that robots help solve labor shortages. Yet, why is a human still involved? How do these robots learn their jobs? What are they bad at? This article investigates these questions, looking at how automation is actually implemented in Japan.

1. A Convenience Store Robot Controlled by a Person in a Distant Office

The company that built the robot is Telexistence. The operator sat in an office in Toranomon, using VR equipment to move the robot in the distant store. The first task was arranging plastic-bottle drinks in the back room of the store[1].

The stated goals were threefold: addressing labor shortages, creating new jobs where people can work from anywhere, and reducing physical contact during the pandemic. The system was designed so one operator could manage multiple stores [1]. This combination—a robot doing the physical work, guided by a human—raises a key question: if robots are meant to take over some of people’s tasks, why is a person still involved?

2. Why Japan Needs Robots: The Working-Age Population Has Shrunk by About 13 Million

To understand the need for robots, we must look at the numbers. According to the Cabinet Office, the population of people aged 15 to 64, who form the core of the workforce, peaked at about 87.16 million in 1995. By October 2024, this number had dropped to about 73.73 million [2]. That is a decrease of roughly 13 million people over about 30 years.

Looking ahead, the ratio of working-age people to those over 65 is projected to fall to 1.3 people per elderly person by 2070 [2]. In a specific store, the burden is visible. At the FamilyMart METI branch, staff used to arrange about 1,000 bottles a day. This work took place in a cold environment, which is physically hard on the body [3]. The government also drafted a strategy in March 2026 to promote AI robots in 16 fields, including manufacturing and logistics [4].

3. Why Industrial Robots Handle Single Tasks Instead of Whole Jobs

Japan is a leader in industrial robots. In 2024, about 450,000 industrial robots were active in the country, ranking second in the world after China [5]. Factory robots excel because the environment is controlled: parts always arrive in the same place and orientation.

Convenience stores are different. Jin Tomioka, who was then Telexistence’s CEO, noted that a Lawson store has about 2,000 types of drinks and prepared foods, with around 200 different shapes [6]. Outside the factory, the world is full of variables and randomness. In August 2022, Telexistence began deploying the "TX SCARA" robot to 300 FamilyMart stores [7]. An AI called "GORDON" analyzes shelf data and sales trends to decide which products to restock first [8].

However, if the AI encounters something unexpected and fails, the system switches to remote control mode. A human then uses VR to fix the issue [3][7]. By January 2025, deployment was still progressing across about 300 stores [9]. The robot does not do the whole job. It handles repetitive tasks, while humans handle the unexpected.

4. How Robot AI Learns by Imitating Human Movements

One way AI learns is through "imitation learning." This involves recording human movements and using that data to adjust the robot’s actions. In one study, researchers used remote control to demonstrate six fine motor tasks, such as threading a cable tie or opening a condiment cup. With only 10 minutes of demonstration data, the success rate reached 80 to 90 percent [10].

Another research team used 13 robots over 17 months to record more than 130,000 episodes of 700+ tasks. For familiar tasks, the success rate was 97 percent. For new tasks, it dropped to 76 percent [11]. Telexistence announced in 2025 that they planned to start a service providing robot motion data to other robot developers and researchers in January 2026[12]. Here, the remote-control technology used in the store is being extended to make demonstrations for robots to learn from.

5. How Robot AI Learns by Practicing in Simulation Thousands of Times

The second method is "reinforcement learning." The AI tries different actions and learns to give higher scores to movements that work well. It repeats this process in large quantities. In a famous experiment, a robot hand learned to solve a Rubik’s Cube. Because real-world practice is slow, the AI practiced in a computer simulation. The paper states this equated to about 13,000 years of experience [13].

To make the simulation realistic, researchers used "automatic domain randomization." They automatically varied the cube’s size, friction, and gravity during training. This is like practicing soccer with different ball sizes and slippery fields. After this training, the robot hand could solve real cubes, even while wearing rubber gloves or being poked by a plush toy [14]. However, the success rate was 60 percent for a standard scramble and only 20 percent for the hardest scramble [13].

6. Why Simple Human Actions Are Hard for Robots (Moravec's Paradox)

Robotics researcher Hans Moravec pointed out a paradox in his 1988 book Mind Children. It is relatively easy for computers to play checkers or do well on IQ tests. But it is very difficult, or nearly impossible, to give a computer the perceptual and motor skills of a one-year-old child [15].

Moravec argued that human sensory and motor skills evolved over a billion years. Reasoning is just a thin layer on top of this deep foundation. This is known as "Moravec's Paradox." We see this in the convenience store robots too. In tests with changed backgrounds, success rates dropped to 59 percent [11]. The hardest Rubik’s Cube scramble had a 20 percent success rate [13].

However, this view has critics. AI researcher Arvind Narayanan argues that we may be focusing only on striking examples. He suggests that reasoning may also require common sense [16]. Numbers from a few experiments cannot prove that the paradox is right.In the store, the system works by combining AI for routine tasks and humans for the rest.

7. How Home Robot Vacuums Began Without Maps

Home robots, like vacuum cleaners, have also evolved. The first Roomba, released in 2002, had no map. It moved almost randomly and changed direction when it hit an obstacle [17]. In 2015, the Roomba 980 introduced camera-based mapping for consumer products, allowing it to see and map the home [18].

In Japan, iRobot Japan announced in 2024 that their robot vacuums had reached a 10 percent household penetration rate by the end of 2023 [19]. This success may come from the fact that cleaning is a repetitive task on a consistent floor. In one research project, a robot learned tasks such as stir-frying shrimp and riding an elevator from 50 demonstrations per task [20]. However, these are research results, not products sold to families.

8. Three Questions to Ask When Reading News About Robots

If you read news about robots helping with labor shortages, ask three questions. First, which specific "task" is the robot handling? Second, who helps when it fails, and how? Third, how much did the AI practice, and where?

Whether an article or product answers all three tells you a lot about it.You can watch videos of the ALOHA project’s robots performing tasks [10]. You can also compare Telexistence’s announcements from 2020, 2022, and 2025 to see how their approach changed [1][7][12]. This example shows how this store’s automation combines work done by robots with help from people.

Sources

  1. FamilyMart "Start of Experimental Operation of Telexistence's Remote-Controlled Robot 'Model-T' for Full Deployment in FamilyMart Stores" (August 26, 2020) https://www.family.co.jp/company/news_releases/2020/20200826_02.html (Press release detailing the pilot in Toshima, VR control from Toranomon, and goals of labor shortage relief and infection control.)
  2. Cabinet Office "Reiwa 7 White Paper on Aging Society" https://www8.cao.go.jp/kourei/whitepaper/w-2025/html/zenbun/s1_1_1.html (Government report on population statistics, showing the decline of the 15-64 age group and future ratios.)
  3. Telexistence "Development of New Robot 'TX SCARA' and Introduction to 'FamilyMart METI Branch'" (November 2, 2021) https://tx-inc.com/ja/blog/2021/11/02/11440/ (Announcement of the robot deployment, noting the 1,000 bottles/day task and cold environment challenges.)
  4. Jiji Press "Strategy Draft to Spread AI Robots" (March 26, 2026) https://www.jiji.com/jc/article?k=2026032601202&g=eco (News report on the government's strategy to promote AI robots in 16 sectors.)
  5. International Federation of Robotics "World Robotics 2025" https://ifr.org/ifr-press-releases/news/global-robot-demand-in-factories-doubles-over-10-years (Global report stating Japan had about 450,000 industrial robots in 2024, ranking second worldwide.)
  6. Nikkei XTECH "Remote-Controlled Robots for Convenience Store Display: Not AI, But Human Perception" (March 18, 2021) https://xtech.nikkei.com/atcl/nxt/column/18/01267/00095/ (Interview with Telexistence CEO discussing the complexity of store environments compared to factories.)
  7. Telexistence "Start of Nationwide Introduction of Artificial Intelligence Robot 'TX SCARA' for FamilyMart" (August 10, 2022) https://tx-inc.com/ja/blog/2022/08/10/11730/ (Announcement of deploying the AI robot to 300 stores, with remote fallback for errors.)
  8. Impress Watch "FamilyMart Deploys 'Convenience Store Display Robot' Working 24 Hours to 300 Stores" (August 10, 2022) https://www.watch.impress.co.jp/docs/news/1431556.html (News article detailing how sales data influences the robot's restocking priority.)
  9. Microsoft "Telexistence, Deploying AI and Remote-Controlled Robots to 300 Convenience Stores, Utilizes Azure" (January 24, 2025) https://www.microsoft.com/ja-jp/customers/story/19978-telexistence-azure (Case study confirming the ongoing deployment to approximately 300 stores.)
  10. Zhao et al. "Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware" (arXiv:2304.13705, 2023) https://arxiv.org/abs/2304.13705 https://tonyzhaozh.github.io/aloha/ (Research paper showing high success rates in fine motor tasks using minimal demonstration data.)
  11. RT-1 "Robotics Transformer for Real-World Control at Scale" (arXiv:2212.06817, 2022) https://arxiv.org/abs/2212.06817 https://robotics-transformer1.github.io/ (Study on large-scale robot learning, showing high success for familiar tasks but lower for new ones.)
  12. Telexistence "Start of Robot Motion Data Generation Service Essential for VLA Development in January 2026" (August 27, 2025) https://tx-inc.com/ja/blog/2025/08/27/12351/ (Announcement of a service selling motion data collected via teleoperation.)
  13. OpenAI et al. "Solving Rubik's Cube with a Robot Hand" (arXiv:1910.07113, 2019) https://arxiv.org/abs/1910.07113 (Paper describing the simulation training method and success rates for solving the cube.)
  14. The Robot Report "Rubik's Cube gets single-handed robotic solution with OpenAI training" (October 2019) https://www.therobotreport.com/rubiks-cube-single-handed-solution-open-ai-training/ (News coverage confirming the robot could solve the cube despite physical interference.)
  15. Hans Moravec Mind Children (Harvard University Press, 1988) https://en.wikipedia.org/wiki/Moravec's_paradox (Book proposing the paradox that high-level reasoning is easier for computers than low-level sensorimotor skills.)
  16. Arvind Narayanan "Fact checking Moravec's paradox" (Normal Tech) https://www.normaltech.ai/p/fact-checking-moravecs-paradox (Newsletter arguing that Moravec's paradox may be based on selection bias and that reasoning needs common sense.)
  17. MIT Technology Review "The Roomba Now Sees and Maps a Home" (September 16, 2015) https://www.technologyreview.com/2015/09/16/247936/the-roomba-now-sees-and-maps-a-home/ (Article contrasting the random movement of early Roombas with the mapping capabilities of the 980.)
  18. iRobot "iRobot Enters the Smart Home with Roomba 980 Vacuum Cleaning Robot" (September 16, 2015) https://media.irobot.com/2015-09-16-iRobot-Enters-the-Smart-Home-with-Roomba-980-Vacuum-Cleaning-Robot (Press release announcing the first consumer product with vSLAM camera mapping.)
  19. iRobot Japan "Achieved 10% National Household Penetration Rate for Own Robot Vacuums" (April 2024) https://prtimes.jp/main/html/rd/p/000000126.000025142.html (Announcement that their robot vacuums reached 10% market penetration in Japan by end of 2023.)
  20. Fu et al. "Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation" (arXiv:2401.02117, 2024) https://arxiv.org/abs/2401.02117 (Research on mobile robots learning tasks like cooking and elevator use from 50 demonstrations each.)