Business
WiMi developed a Closed-loop Hybrid-Signal Brain-Machine Interface Robotic Arm Control System Based on AR
BEIJING, July 27, 2023 /PRNewswire/ -- WiMi Hologram Cloud Inc. (NASDAQ: WIMI) ("WiMi" or the "Company"), a leading global Hologram Augmented Reality ("AR")
About this update from Wimi Hologram Cloud Inc.
[{"type":"text","content":"BEIJING, July 27, 2023 /PRNewswire/ -- WiMi Hologram Cloud Inc. (NASDAQ: WIMI) (\"WiMi\" or the \"Company\"), a leading global Hologram Augmented Reality (\"AR\") Technology provider, today announced that an AR-guided assistance method is outlined to provide enhanced visual feedback to the user for closed-loop control using a hybrid BMI that combines EEG signals and eye tracking for intuitive and effective control of the robotic arm.\nA closed-loop hybrid-signal brain-machine interface robotic arm control method based on augmented reality by WiMi enhances visual feedback for the user by combining BMI based on electroencephalogram (EEG) signals and eye tracking techniques to achieve closed-loop control during the control of the robotic arm. The system integrates the functions of BMI, eye tracking, image processing, automation, and AR interface to allow the user to perform object manipulation tasks. Image processing is used to segment all potential rectangular objects from the image of the workspace. The user can use eye tracking to select the segmented objects. The output decoded from the BMI is used to (1) confirm the user-selected object, (2) switch the sequence of actions, and (3) continuously control the aperture and height of the fixture during gripping and lifting. The user-selected object and the status of the gripping and lifting operations are fed back to the user in real-time via a computer screen using AR technology. Finally, the robotic arm performs stretching, grasping, lifting, delivering and releasing tasks based on the output of the hybrid BMI decoding. The system device equipment includes an eye tracker, EEG headset, computer, robotic arm, and USB camera. Interaction between the user and the system is performed using hybrid gaze BMI and AR-enhanced visual feedback.\nA closed-loop hybrid-signal BMI robotic arm control system based on AR of WiMi includes:\nAugmented Reality Control Interface: Through AR technology, an intuitive and easy-to-use control interface is designed so that users can control the movement of the robotic arm through gestures or voice.\nAcquisition of EEG Signals: The electrical signals from the user's brain are captured using EEG equipment and transmitted to a computer.\nProcessing EEG signals: Using signal processing algorithms, EEG signals are filtered, features are extracted, and other oper...