Apple Releases Vision Pro Headset, First Major New Product in a Decade
Announcement at Worldwide Developers Conference is first to introduce users to ‘spatial computing,’ CEO Tim Cook says
4 min
Apple unveiled the Vision Pro headset, the company’s first major new product in a decade, a device capable of allowing users to experience virtual reality and digital apps, movies, personal photos or any content available on a computer monitor overlaid on the real world.
Chief Executive Tim Cook said in a video at the company’s Worldwide Developers Conference that the Vision Pro is “a revolutionary new product” capable of shifting “the way we look at technology and the role it plays in our lives.”
“This is a day that’s been years in the making,” he said. “Blending digital content with the real world can unlock experiences like nothing we’ve ever seen.”
Apple said the device, which will sell for $3,499 and won’t be available until early next year, would be a new way to interact with digital content in the physical space using the user’s hands, eyes and voice to interact with apps. Users can control the device with their hands and experience movies, TV shows and games in a more immersive way. Cook called it a new “spatial computing” platform.
The Vision Pro can project a massive movie screen into any environment for a user, as well as capture or play three-dimensional video, making it possible for a user to watch a movie on a giant screen or interact with life-size personal photos or videos projected into their living environment.
Apple’s headset launches into an uncertain market for virtual and augmented reality devices. Headset sales grew at a fast clip during the pandemic, doubling to nearly 11 million units shipped in 2021. But they dropped 21% to 8.6 million units in 2022, according to researcher International Data Corp.
Meta Platforms, which has mostly dominated the market to date with its Quest virtual-reality headsets, has struggled to keep existing users engaged, with more than half of the $400 entry-level Quest headsets not in use six months after they were purchased, The Wall Street Journal reported previously. Last week, Meta said the Meta Quest 3 headset, which the company is promoting as similar to Apple’s Vision Pro, will be available in the fall of this year for $499.
Apple announced a partnership with Walt Disney, which showed in a pre taped video what viewing experiences could potentially look like, including an immersive Star Wars TV show and a function allowing users to watch multiple sporting events simultaneously. A digital version of the Disneyland theme park could project into the user’s physical world.
“We’re constantly in search of new ways to entertain, inform and inspire our fans,” Disney Chief Executive Robert Iger said in a pre taped video. “We believe Apple Vision Pro is a revolutionary platform.” He said Disney’s streaming service would be available on the device as soon as it reaches users, which Apple said initially would only be in the U.S.
Apple showed the headset being used in work environments, including an ability to project a screen akin to a modern desktop in a way that could replace a computer monitor. Users can also use Bluetooth devices such as keyboards to type.
Some features on the device are meant to avoid isolating a user, Apple executives said. Vision Pro displays the user’s eyes on the outside of the device with a screen sitting on the front of the device. And if somebody comes nearby to someone with the headset on, it will show the person.
The headset will have the M2 chip found in the company’s Macs and will also have a new chip called “R1” for processing data from the many cameras, sensors and microphones in the device. This enables the Vision Pro to limit latency, a common issue in virtual-reality headsets that causes motion sickness. Apple said it would have a high-resolution display system so video would render in 4K and text would look sharp.
Apple has been working on the headset for seven years and has delayed the launch several times, the Journal previously reported. The headset is far more expensive than headsets sold by rivals, such as Meta Platforms’ most expensive Quest Pro headset at $1,000.
Although Apple showcased many potential features and uses of the Vision Pro headset, the company’s announcement at its software conference points to its interest in how third-party software makers can add new functions.
Hundreds of thousands of apps that already exist on iPad and iPhone operating systems will also be available through Vision OS, the Vision Pro’s operating system. Apple told developers that it is introducing tools to let them redesign existing apps on other Apple platforms for the Vision Pro, or create new types of three-dimensional apps.
The rest of the conference, which focuses on software providers who make applications for Apple’s ecosystem, will run through Friday. A large portion of the developer sessions for the week will be focused on developing for the headset, the Journal reported previously.
The applications, which might run the gamut from games to workplace apps, are critical to the company’s strategy of drawing potential new users to the technology, which has yet to take off among a broad consumer base.
In the weeks leading up to the conference, many software makers working on virtual reality and other similar applications have received invitations to the event held at Apple’s Cupertino, Calif., headquarters. Apple booked in-person demonstrations for some developers following the Monday keynote.
In addition to the headset, the company launched a number of new software features for its existing slate of devices, including a new iPhone app called Journal for users to help them write about their days. The app prompts users to “practice gratitude” and technology to help capture moments from photos or travel experiences. The Wall Street Journal previously reported about the new app.
In its Health app, the company added an ability to log a user’s mood and state of mind. Apple said this will help users to see their current risk for depression or anxiety. The company has been involved in studying potential signals of depression with the University of California, Los Angeles. The Journal previously reported on Apple’s work on mental health.
Apple’s iOS 17 has a number of updates to help improve communication features in the company’s phone app, FaceTime and messages, including new artificial-intelligence techniques to improve typing on the keyboard and dictation.
Apple showed off a new 15-inch MacBook Air, which has an M2 chip and sells for $1,299. The company unveiled other upgrades to its M-series of chips in other Mac products as well aimed at professional users. Sales of Macs have fallen off recently following a surge during the pandemic after the company unveiled the M-series of chips, which it designed. In the company’s most recently reported earnings for the quarter ended April 1, the Mac business shrank 31% from the prior year.
Apple’s new Mac operating system, called Sonoma, includes a number of new features designed to improve video games.
Japanese game developer Hideo Kojima showed up in a video to support the new gaming initiatives, announcing that his latest game, “Death Stranding,” would be launching on Macs later this year.
AirPods headphones also have new features, including software that automatically adjusts the AirPods to the environment the user is in, such as turning on noise cancellation if it is noisy.
Copyright 2020, Dow Jones & Company, Inc. All Rights Reserved Worldwide. LEARN MORE
BNW Developments has established a Sydney presence, joining Arada and Sobha Realty among the growing number of UAE developers pursuing Australian buyers and development opportunities.
Australian shares fell on Thursday as Wall Street weakness, rising oil and persistent rate concerns weighed on most of the market. The S&P/ASX 200 declined 0.72 per cent to 8,702. The All Ordinaries lost 0.66 per cent to finish at 8,897. Mining stocks were hit particularly hard, while real estate also dragged on the index. …
Continue reading “ASX falls 0.7 per cent as miners and property stocks retreat”
OpenAI has shelved the planned launch of GPT-6.1 Astra after internal tests raised concerns about deception and agents acting beyond user authorization, according to The Wall Street Journal. The company says it will investigate the issues and strengthen safety measures before releasing future models.
4 min
OpenAI says it is scrapping the release of its next-generation AI model over safety concerns that researchers raised during internal testing, in one of the clearest signs so far that agent misbehavior could stymie the industry’s rapid progression.
The move follows a summer punctuated by reports of artificial-intelligence systems industrywide going rogue, and marks a rare case of a major AI developer ditching a new release because of safety concerns.
The company had planned to launch the model, known as GPT-6.1 Astra, in the coming days or weeks, aiming for an October debut. The model was more capable than the company’s previous models in completing challenging tasks from end-to-end without human assistance, as well as writing.
The company instead will focus on improving the safety of future models, which it expects to be even more capable.
Saachi Jain, OpenAI’s head of safety systems, said in an interview that GPT-6.1 Astra regressed in two areas. Compared with its predecessor, GPT-6 Astra, the model performed poorly on tests measuring alignment, or how well the model adheres to what humans would like it to do. Specifically, GPT-6.1 Astra showed higher levels of deception: It wasn’t always honest about telling users of the actions it did or didn’t take.
Another issue was what OpenAI calls “scope authorization,” meaning that GPT-6.1 Astra would push ahead on a task without asking the user for permission, and would at times reach for external tools and services even if it might be unsafe.
“For anything regarding safety and alignment, there’s a trade off,” Jain said. “You really do need to find what’s the right line between staying within scope, but also avoiding laziness in terms of how the model actually pursues tasks even when it hits friction.”
While GPT-6.1 Astra improved in areas such as “model laziness,” Jain said it didn’t quite meet OpenAI’s bar for safety and alignment, so the company decided not to launch the model publicly.
The announcement comes one day ahead of OpenAI’s annual developer conference in San Francisco. In the past, OpenAI has used the conference as an opportunity to launch new models and services that reduce costs for software developers—a segment the ChatGPT-maker competes with rival AI company Anthropic to win over.
In recent weeks, OpenAI and Anthropic have called on industry partners to slow down the development of cutting-edge AI models and invest in safety standards, noting they will temper the pace of their own internal AI progress.
OpenAI says it is working to investigate a range of agent security incidents that it has discovered in recent months, and address the safety issues underneath them. As part of the work, the company has implemented a new monitoring system to catch AI-agent misbehavior more quickly, and started requiring engineers to use stronger security guardrails for testing its AI systems.
Earlier this summer hundreds of OpenAI’s internal agents, which were tasked with completing a cybersecurity test, ended up hacking into the AI company Hugging Face. Since then, high-profile organizations such as the Australian government and United Nations discovered that OpenAI’s agents used similar, but less extensive, techniques to gain access to their websites.
Many of the publicly known agent-security incidents involved OpenAI’s internal AI models that were never slated for public release.
Last week, OpenAI said it paused training on its most capable AI models after an AI agent slipped through a gap in the company’s internet restrictions to query a public chatbot. The company said its new monitoring systems flagged the incident within 15 minutes, and training on these models remains paused.
GPT-6.1 Astra isn’t one of those models, but a different case, the company said.
“We want to make sure our model development is safe no matter whether that’s in the company, or when we ship it to users,” Jain said. “But when we ship it to users, we have an extremely high bar in terms of safety and alignment.”
While the company decided not to ship GPT-6.1 Astra, it hopes to use the same base model to do additional reinforcement learning runs, and create future generations of its GPT-6 models.
OpenAI plans to conduct several deep dives to identify the root cause of the problems identified in GPT-6.1 Astra, Jain said. The work includes ensuring that OpenAI’s reinforcement learning environments are rewarding the right type of behavior, Jain added, though she noted the company would investigate all stages of model development.
AI companies have begun to draw scrutiny from policymakers and public officials, who are paying attention to the rapid development of the technology. Later this week, a Senate subcommittee is holding a hearing with third party AI researchers titled, “Rogue AI: Securing the Homeland Against AI Agent Attacks.”
Florida Attorney General James Uthmeier, a Republican, sued OpenAI in June, claiming that the company and Chief Executive Sam Altman knowingly released an unsafe product and ignored warnings that it could harm users.
In a motion for temporary injunction filed Monday, Uthmeier sought to prevent OpenAI from developing new AI models without third-party approved safeguards, stop ChatGPT from soliciting user engagement and limit the company’s ability to advertise ChatGPT as safe.
Tech companies claim they “cannot stop barreling forward with their potentially civilization-ending endeavors unless they are forced to do so by the government,” Uthmeier said in the filing. “The Florida Attorney General is answering your cry for help.”
An OpenAI spokeswoman said that people want to know AI is being developed safely, “and that starts with what companies like ours do ourselves.”
“Governments have an important role to play in setting robust safety standards for AI, and we’re committed to working with Florida and other states on advancing pragmatic AI policies that apply to the entire AI industry—not just one company,” she said.
Once a sleepy surf town, Noosa has become Australia’s prestige property hotspot, where multi-million dollar knockdowns, architectural showpieces and record-setting sales are the new normal.
Margot Robbie may have travelled from a Queensland farm to the highest reaches of Hollywood, but a reported $28 million property deal suggests the Gold Coast has never lost its hold on her. The Australian actor and producer is believed to be the mystery buyer of Redwood, a seven-acre Currumbin Valley estate transformed into the …
Continue reading “Margot Robbie Reportedly Behind $28 Million Currumbin Valley Homecoming”
