Meta Unveils Orion, an Augmented Reality Glasses Prototype: Sci-Fi Concept Becomes Reality

Meta Unveils Orion, an Augmented Reality Glasses Prototype: Sci-Fi Concept Becomes RealityOn Wednesday, September 26th, Meta, the parent company of social media giant Facebook, officially unveiled its augmented reality glasses prototype, Orion, at its annual Connect developer conference. While still in development, the device has demonstrated the ability for users to control Orion through eye movements and finger gestures, bringing the augmented reality spectacles seen in science fiction movies closer to real-world application

Meta Unveils Orion, an Augmented Reality Glasses Prototype: Sci-Fi Concept Becomes Reality

On Wednesday, September 26th, Meta, the parent company of social media giant Facebook, officially unveiled its augmented reality glasses prototype, Orion, at its annual Connect developer conference. While still in development, the device has demonstrated the ability for users to control Orion through eye movements and finger gestures, bringing the augmented reality spectacles seen in science fiction movies closer to real-world application.

Visually, Meta's AR glasses resemble ordinary glasses but appear slightly bulky and have a sunglass-like effect. However, this device under development is far from ordinary - it represents the latest attempt to turn the sci-fi concept of augmented reality glasses into a practical product. Wearers can clearly see the real world around them while miniature LED projectors overlay images and text within their field of view.

Bloomberg reporters conducted in-depth testing of the Orion glasses at Meta's Menlo Park, California headquarters. In the tests, Orion was used to play YouTube videos, read text messages, make video calls, and even generate recipe recommendations by scanning ingredients. The glasses' display is controlled through eye movements, while a companion wristband translates subtle finger movements into screen "clicks" or "scrolling."

Rahul Prasad, senior product manager at MetaRealityLabs, stated that tasks that previously required a phone or laptop "become faster, richer, and more convenient."

Currently, the Orion glasses are not ready for consumer sale, at least not at this stage. Meta employees are conducting internal testing with the hope of eventually releasing a product priced comparably to a high-end laptop.

The team responsible for developing the Orion glasses previously created Meta's latest Ray-Ban smart glasses. These smart glasses come equipped with an AI assistant but lack true augmented reality capabilities. Some of the same components, such as speakers and microphones, are also found in Orion glasses. Miniaturization of these components has driven the development of both devices.

The lenses of the Orion glasses have a slight tint as they are not made of glass but from silicon carbide, a material commonly used in energy conversion and battery systems for electric vehicles. Silicon carbide can refract light at extreme angles, allowing users to see the real world clearly as they would with regular lenses without experiencing the rainbow effect or scattered light, common issues with other augmented reality headsets. Additionally, silicon carbide is lighter than glass, contributing to the long-standing weight problem.

The frame of the Orion glasses is made of magnesium, further reducing the weight. Magnesium is highly conductive and evenly dissipates heat, minimizing user awareness of the complex internal electronics.

The Orion system consists of three components: the glasses, a wristband, and a wireless computer called a "puck." The glasses are equipped with five front-facing cameras that help Orion determine its location, running on simultaneous localization and mapping (SLAM) technology. The cameras also provide data for AI features and track user hand movements. Visually, the cameras are not obtrusive. Two cameras located on the inside of the frame track eye movement.

Meta has developed over 10 custom chips for Orion to manage features like hand tracking, eye tracking, and image display. The low-energy design of these chips effectively prevents the glasses from overheating.

Using Orion glasses feels akin to using your eyes as a computer mouse. Users simply look at the application or icon they want to activate, and the corresponding element lights up. Then, subtle hand or finger movements are used to "click," detected by the accompanying wristband. Pinching the thumb and index finger acts as a mouse click, while pinching the thumb and middle finger returns to the home screen. These hand gestures are intuitive and easy to pick up, making them one of the most impressive aspects of the Orion experience.

Meanwhile, users do not need to carry the puck around, only keeping it within a reasonable range. The puck acts as a portable computer, providing all the necessary computing power.

The images in the user's field of view are clear and vibrant, and the placement of applications and labels can be adjusted as needed, including their displayed depth within the real environment. For example, two users wearing Orion glasses can play a "ping-pong" game projected onto a table, seamlessly blending real-world elements with game content, a feat impossible with virtual reality glasses. Even Apple's VisionPro headset doesn't allow users to directly observe the real world around them.

A potential drawback is that Orion users may not realize how odd their movements appear to others. Despite the intuitive nature of the hand gesture control, users tend to become immersed in the experience and disregard how their actions might look to onlookers.

In the final demonstration, users were able to scroll through a stream of Instagram Reels videos on a floating screen through the Orion glasses. A "coin toss" gesture with the thumb allows the video stream to scroll, and SLAM technology ensures the display remains relatively fixed within the room, though users can manually adjust its position. As a result, as the user turns their head or moves to talk to someone, the Reels video stream appears in the line of sight intermittently rather than constantly following the user's gaze. This helps users maintain a better connection with the real world.