doi:10.1017/S0269888924000080

Apvrille , L., Tanzi , T. & Dugelay , J. 2014. Autonomous drones for assisting rescue services within the context of natural disasters. In 2014 XXXIth URSI General Assembly and Scientific Symposium (URSI GASS).

Baltes , J., Christmann , G. & Saeedvand , S. 2023. A deep reinforcement learning algorithm to control a two-wheeled scooter with a humanoid robot. Engineering Applications of Artificial Intelligence 126, 106941.

Batula , A. M. & Kim , Y. E. 2010. Development of a mini-humanoid pianist. In 2010 10th IEEE-RAS International Conference on Humanoid Robots, Nashville, TN, USA.

Beeson , P. & Ames , B. 2015. TRAC-IK: An open-source library for improved solving of generic inverse kinematics. In 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), Seoul.

Bochkovskiy , A., Wang , C.-Y. & Liao , H.-Y.M. 2020. YOLOv4: Optimal Speed and Accuracy of Object Detection.

Bogue , R. 2015. Underwater robots: a review of technologies and applications. Industrial Robot: An International Journal 42(3), 186–191.

Boularias , A., Bagnell , J. A. & Stentz , A. 2015. Learning to manipulate unknown objects in clutter by reinforcement. In Twenty-Ninth AAAI Conference on Artificial Intelligence.

Brockman , G., Sutskever , I. & Altman , S. 2020. (5/18/2020), [website], OpenAI, Retrieved from https://gym.openai.com/.

Chen , X. & Guhl , J. 2018. Industrial robot control with object recognition based on deep learning. Procedia CIRP 76, 149–154.

Colomé , A. & Torras , C. 2020. Inverse kinematics and relative arm positioning. In Reinforcement Learning of Bimanual Robot Skills, 25–52. Springer.

Fang , K. et al. 2020. Learning task-oriented grasping for tool manipulation from simulated self-supervision. The International Journal of Robotics Research 39(2-3), 202–216.

Finn , C., et al. 2016. Deep spatial autoencoders for visuomotor learning. In 2016 IEEE International Conference on Robotics and Automation (ICRA). IEEE.

Gu , S., et al. 2017. Deep reinforcement learning for robotic manipulation with asynchronous off-policy updates. In 2017 IEEE International Conference on Robotics and Automation (ICRA).

Guo , G. & Zhang , N. 2019. A survey on deep learning based face recognition. Computer Vision and Image Understanding 189, 102805.

Hafner , D., et al. 2020. Mastering atari with discrete world models. arXiv preprint arXiv:2010.02193.

Han , G.-J., et al. 2020. Curiosity-driven variational autoencoder for deep Q network. In Pacific-Asia Conference on Knowledge Discovery and Data Mining. Springer.

Hinton , G. E., Krizhevsky , A. & Wang , S. D. 2011. Transforming auto-encoders. In International Conference on Artificial Neural Networks. Springer.

Hinton , G. E. & Salakhutdinov , R. R. 2006. Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507.

Hoof , H. V., et al. 2015. Learning robot in-hand manipulation with tactile features. In 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

Huang , S. H., et al. 2019. Learning Gentle Object Manipulation with Curiosity-Driven Deep Reinforcement Learning. arXiv preprint arXiv:1903.08542.

Jiang , Y., Moseson , S. & Saxena , A. 2011. Efficient grasping from rgbd images: Learning using a new rectangle representation. In 2011 IEEE International Conference on Robotics and Automation. IEEE.

Johnson , M. et al. 2015. Team IHMC’s lessons learned from the DARPA robotics challenge trials. Journal of Field Robotics 32(2), 192–208.

Kajita , S., et al. 2014. Introduction to Humanoid Robotics. Springer.

Kalakrishnan , M., et al. 2011. Learning force control policies for compliant manipulation. In 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

Khansari , M., et al. 2020. Action Image Representation: Learning Scalable Deep Grasping Policies with Zero Real World Data. arXiv preprint arXiv:2005.06594.

Kim , C. & Park , J. 2019. Designing online network intrusion detection using deep auto-encoder Q-learning. Computers & Electrical Engineering 79, 106460.

Kober , J., Bagnell , J. A. & Peters , J. 2013. Reinforcement learning in robotics: A survey. The International Journal of Robotics Research 32(11), 1238–1274.

Kohlbrecher , S. et al. 2015. Human-robot teaming for rescue missions: Team ViGIR’s approach to the 2013 DARPA robotics challenge trials. Journal of Field Robotics 32(3), 352–377.

Kurnia , D.W., et al. 2017. A control scheme for typist robot using Artificial Neural Network. In 2017 International Conference on Sustainable Information Engineering and Technology (SIET), Malang, Indonesia.

Kurniawan , D.A., et al. 2017. Comparison of extreme learning machine and neural network method on hand typist robot for quadriplegic person. In 2017 International Symposium on Electronics and Smart Devices (ISESD), Yogyakarta, Indonesia.

Kurniawan , D.A., et al. 2017. Hand typist robot modelling for quadriplegic person using extreme learning machine. In 2017 15th International Conference on Quality in Research (QiR) : International Symposium on Electrical and Computer Engineering, Nusa Dua, Indonesia.

Laschi , C., et al. 2000. Grasping and manipulation in humanoid robotics. Scuola Superiore Sant Anna, Italia.

LeCun , Y. et al. 1998. Gradient-based learning applied to document recognition. Proceedings of the IEEE 86(11), 2278–2324.

Lenz , I., Lee , H. & Saxena , A. 2015. Deep learning for detecting robotic grasps. The International Journal of Robotics Research 34(4-5), 705–724.

Levine , S. et al. 2016. End-to-end training of deep visuomotor policies. The Journal of Machine Learning Research 17(1), 1334–1373.

Li , Y. & Chuang , L. 2013. Controller design for music playing robot — Applied to the anthropomorphic piano robot. In 2013 IEEE 10th International Conference on Power Electronics and Drive Systems (PEDS).

Li , Z. et al. 2017. Brain-actuated control of dual-arm robot manipulation with relative motion. IEEE Transactions on Cognitive and Developmental Systems 11(1), 51–62.

Lillicrap , T. P., et al. 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971.

Lin , J., et al. 2010. Electronic piano playing robot. In 2010 International Symposium on Computer, Communication, Control and Automation (3CA).

Lioutikov , R., et al. 2016. Learning manipulation by sequencing motor primitives with a two-armed robot. In Intelligent Autonomous Systems, 13, 1601–1611. Springer.

Liu , L. et al. 2020. Deep learning for generic object detection: A survey. International Journal of Computer Vision 128(2), 261–318.

Liu , N., et al. 2017. A hierarchical framework of cloud resource allocation and power management using deep reinforcement learning. In 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS). IEEE.

Magid , E., et al. 2020. Artificial intelligence based framework for robotic search and rescue operations conducted jointly by international teams. In Proceedings of 14th International Conference on Electromechanics and Robotics “Zavalishin’s Readings”. Springer Singapore.

Maier , D., Zohouri , R. & Bennewitz , M. 2014. Using visual and auditory feedback for instrument-playing humanoids. In 2014 IEEE-RAS International Conference on Humanoid Robots.

Mandala , H., Saeedvand , S. & Baltes , J. 2020. Synchronous dual-arm manipulation by adult-sized humanoid robot. In 2020 International Conference on Advanced Robotics and Intelligent Systems (ARIS). IEEE.

Masci , J., et al. 2011. Stacked convolutional auto-encoders for hierarchical feature extraction. In International Conference on Artificial Neural Networks. Springer.

Mnih , V. et al. 2015. Human-level control through deep reinforcement learning. Nature 518(7540), 529–533.

Moosavian , S. A. A., Semsarilar , H. & Kalantari , A. 2006. Design and manufacturing of a mobile rescue robot. In 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

Murphy , R. R. 2012. A decade of rescue robots. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

Ozawa , R. et al. 2005. Control of an object with parallel surfaces by a pair of finger robots without object sensing. IEEE Transactions on Robotics 21(5), 965–976.

Pastor , P., et al. 2011. Skill learning and task outcome prediction for manipulation. In 2011 IEEE International Conference on Robotics and Automation.

Piazzi , A. & Visioli , A. 2000. Global minimum-jerk trajectory planning of robot manipulators. IEEE Transactions on Industrial Electronics 47(1), 140–149.

Qu , J. et al. 2019. Human-like coordination motion learning for a redundant dual-arm robot. Robotics and Computer-Integrated Manufacturing 57, 379–390.

Rajeswaran , A., et al. 2017. Learning complex dexterous manipulation with deep reinforcement learning and demonstrations. arXiv preprint arXiv:1709.10087.

Ranzato , M.A., et al. 2007. Unsupervised learning of invariant feature hierarchies with applications to object recognition. In 2007 IEEE Conference on Computer Vision and Pattern Recognition. IEEE.

Ren , W., Han , D. & Wang , Z. 2022. Research on dual-arm control of lunar assisted robot based on hierarchical reinforcement learning under unstructured environment. Aerospace 9(6), 315.

Saeedvand , S. et al. 2019. A comprehensive survey on humanoid robot development. The Knowledge Engineering Review 34, e20, 1–18.

Saeedvand , S., Aghdasi , H. S. & Baltes , J. 2019. Robust multi-objective multi-humanoid robots task allocation based on novel hybrid metaheuristic algorithm. Applied Intelligence 49(12), 4097–4127.

Saeedvand , S., Aghdasi , H. S. & Baltes , J. 2020. Novel hybrid algorithm for team orienteering problem with time windows for rescue applications. Applied Soft Computing 96, 106700.

Saeedvand , S., Mandala , H. & Baltes , J. 2021. Hierarchical deep reinforcement learning to drag heavy objects by adult-sized humanoid robot. Applied Soft Computing 110, 107601.

Saxena , A., Driemeyer , J. & Ng , A. Y. 2008. Robotic grasping of novel objects using vision. The International Journal of Robotics Research 27(2), 157–173.

Seker , M. Y., Tekden , A. E. & Ugur , E. 2019. Deep effect trajectory prediction in robot manipulation. Robotics and Autonomous Systems 119, 173–184.

Silver , D., et al. 2014. Deterministic policy gradient algorithms.

Stulp , F., Theodorou , E. A. & Schaal , S. 2012. Reinforcement learning with sequences of motion primitives for robust manipulation. IEEE Transactions on Robotics 28(6), 1360–1370.

Sugano , S. & Kato , I. 1987. WABOT-2: Autonomous robot with dexterous finger-arm–Finger-arm coordination control in keyboard performance. In Proceedings. 1987 IEEE International Conference on Robotics and Automation. IEEE.

Sutton , R. S., et al. 2000. Policy gradient methods for reinforcement learning with function approximation. In Advances in Neural Information Processing Systems.

Vincent , P., et al. 2008. Extracting and composing robust features with denoising autoencoders. In Proceedings of the 25th International Conference on Machine Learning.

Wang , C. et al. 2020. Learning mobile manipulation through deep reinforcement learning. Sensors 20(3), 939.

Weng , C.-Y., Tan , W. C. & Chen , I.-M. 2019. A survey of dual-arm robotic issues on assembly tasks. In ROMANSY 22–Robot Design, Dynamics and Control, 474–480. Springer.

Wu , Z., Shen , C. & Van Den Hengel , A. 2019. Wider or deeper: Revisiting the resnet model for visual recognition. Pattern Recognition 90, 119–133.

Yan , L., et al. 2016. Coordinated compliance control of dual-arm robot for payload manipulation: Master-slave and shared force control. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE.

Ye , G., Thobbi , A. & Sheng , W. 2011. Human-robot collaborative manipulation through imitation and reinforcement learning. In 2011 IEEE International Conference on Information and Automation.

Zhang , A., Malhotra , M. & Matsuoka , Y. 2011. Musical piano performance by the ACT Hand. In 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.

Zhang , D., et al. 2009. Design and analysis of a piano playing robot. In 2009 International Conference on Information and Automation.

Zhang , F., et al. 2015. Towards vision-based deep reinforcement learning for robotic motion control. arXiv preprint arXiv:1511.03791.

Zhu , H., et al. 2019. Dexterous manipulation with deep reinforcement learning: Efficient, general, and low-cost. In 2019 International Conference on Robotics and Automation (ICRA). IEEE.