As we inched nearer, I worried about infringing upon the other participants’ personal space. Then I remembered that oceans and thousands of miles separated me from them—and wasn’t ditching the notion of personal space the whole point? So I tried to settle into the intimacy.
“What happens in VR is that sense of completely forgetting about the existence of the external world,” says Agnieszka Sekula, a PhD candidate at the Centre for Human Psychopharmacology in Australia and a cofounder of a company that uses VR to enhance psychedelic therapy. “So there is definitely similarity there to this sense of experiencing an alternate reality under psychedelics that feels more real than what’s actually out there.”
But, she adds, “there’s definitely differences between what a psychedelic experience feels like and what virtual reality feels like.” Because of this, she appreciates that Isness-D charts a new path to transcendence instead of just mimicking one that existed already.
More research is needed on the enduring effects of an Isness-D experience and whether virtual reality, in general, can induce benefits similar to psychedelics. The dominant theory on how psychedelics improve clinical outcomes (a debate far from settled) is that their effect is driven by both the subjective experience of a trip and the drug’s neurochemical effect on the brain. Since VR only mirrors the subjective experience, its clinical benefit, which has yet to be rigorously tested, may not be as strong.
Jacob Aday, a psychiatry researcher at the University of California, San Francisco, says he wishes the study had measured participants’ mental wellness. He thinks VR likely can downregulate the default mode network—a brain network that’s active when our thoughts aren’t directed at a specific task, and which psychedelics can suppress (scientists theorize that this is what causes ego death). People shown awe-inspiring videos have diminished activity in this network. VR is better at inducing awe than regular video, so Isness-D might similarly dial it down.
Already, a startup called aNUma that spun out of Glowacki’s lab allows anyone with a VR headset to sign up for Isness sessions weekly. The startup sells a shortened version of Isness-D to companies for virtual wellness retreats, and provides a similar experience called Ripple to help patients, their families, and their caregivers cope with terminal illness. A coauthor of the paper describing Isness-D is even piloting it in couples and family therapy.
“What we’ve found is that representing people as pure luminosity really releases them from a lot of judgments and projections,” Glowacki says. That includes negative thoughts about their body and prejudices. He has personally facilitated aNUma sessions for cancer patients and their loved ones. One, a woman with pancreatic cancer, died days later. The last time she and her friends gathered was as mingling balls of light.
For one phase of my Isness-D experience, moving created a brief electric trail that marked where I’d just been. After a few moments of this, the narration prodded: “What does it feel like to see the past?” I started to think of people from my past who I missed or had hurt. In sloppy cursive, I used my finger to write their names in the air. Just as quickly as I scribbled them, I watched them vanish.
Meta’s new AI can turn text prompts into videos
Although the effect is rather crude, the system offers an early glimpse of what’s coming next for generative artificial intelligence, and it is the next obvious step from the text-to-image AI systems that have caused huge excitement this year.
Meta’s announcement of Make-A-Video, which is not yet being made available to the public, will likely prompt other AI labs to release their own versions. It also raises some big ethical questions.
In the last month alone, AI lab OpenAI has made its latest text-to-image AI system DALL-E available to everyone, and AI startup Stability.AI launched Stable Diffusion, an open-source text-to-image system.
But text-to-video AI comes with some even greater challenges. For one, these models need a vast amount of computing power. They are an even bigger computational lift than large text-to-image AI models, which use millions of images to train, because putting together just one short video requires hundreds of images. That means it’s really only large tech companies that can afford to build these systems for the foreseeable future. They’re also trickier to train, because there aren’t large-scale data sets of high-quality videos paired with text.
To work around this, Meta combined data from three open-source image and video data sets to train its model. Standard text-image data sets of labeled still images helped the AI learn what objects are called and what they look like. And a database of videos helped it learn how those objects are supposed to move in the world. The combination of the two approaches helped Make-A-Video, which is described in a non-peer-reviewed paper published today, generate videos from text at scale.
Tanmay Gupta, a computer vision research scientist at the Allen Institute for Artificial Intelligence, says Meta’s results are promising. The videos it’s shared show that the model can capture 3D shapes as the camera rotates. The model also has some notion of depth and understanding of lighting. Gupta says some details and movements are decently done and convincing.
However, “there’s plenty of room for the research community to improve on, especially if these systems are to be used for video editing and professional content creation,” he adds. In particular, it’s still tough to model complex interactions between objects.
In the video generated by the prompt “An artist’s brush painting on a canvas,” the brush moves over the canvas, but strokes on the canvas aren’t realistic. “I would love to see these models succeed at generating a sequence of interactions, such as ‘The man picks up a book from the shelf, puts on his glasses, and sits down to read it while drinking a cup of coffee,’” Gupta says.
How AI is helping birth digital humans that look and sound just like us
Jennifer: And the team has also been exploring how these digital twins can be useful beyond the 2D world of a video conference.
Greg Cross: I guess the.. the big, you know, shift that’s coming right at the moment is the move from the 2D world of the internet, into the 3D world of the metaverse. So, I mean, and that, and that’s something we’ve always thought about and we’ve always been preparing for, I mean, Jack exists in full 3D, um, You know, Jack exists as a full body. So I mean, Jack can, you know, today we have, you know, we’re building augmented reality, prototypes of Jack walking around on a golf course. And, you know, we can go and ask Jack, how, how should we play this hole? Um, so these are some of the things that we are starting to imagine in terms of the way in which digital people, the way in which digital celebrities. Interact with us as we move into the 3D world.
Jennifer: And he thinks this technology can go a lot further.
Greg Cross: Healthcare and education are two amazing applications of this type of technology. And it’s amazing because we don’t have enough real people to deliver healthcare and education in the real world. So, I mean, so you can, you know, you can imagine how you can use a digital workforce to augment. And, and extend the skills and capability, not replace, but extend the skills and, and capabilities of real people.
Jennifer: This episode was produced by Anthony Green with help from Emma Cillekens. It was edited by me and Mat Honan, mixed by Garret Lang… with original music from Jacob Gorski.
If you have an idea for a story or something you’d like to hear, please drop a note to podcasts at technology review dot com.
Thanks for listening… I’m Jennifer Strong.
A bionic pancreas could solve one of the biggest challenges of diabetes
The bionic pancreas, a credit card-sized device called an iLet, monitors a person’s levels around the clock and automatically delivers insulin when needed through a tiny cannula, a thin tube inserted into the body. It is worn constantly, generally on the abdomen. The device determines all insulin doses based on the user’s weight, and the user can’t adjust the doses.
A Harvard Medical School team has submitted its findings from the study, described in the New England Journal of Medicine, to the FDA in the hopes of eventually bringing the product to market in the US. While a team from Boston University and Massachusetts General Hospital first tested the bionic pancreas in 2010, this is the most extensive trial undertaken so far.
The Harvard team, working with other universities, provided 219 people with type 1 diabetes who had used insulin for at least a year with a bionic pancreas device for 13 weeks. The team compared their blood sugar levels with those of 107 diabetic people who used other insulin delivery methods, including injection and insulin pumps, during the same amount of time.
The blood sugar levels of the bionic pancreas group fell from 7.9% to 7.3%, while the standard care group’s levels remained steady at 7.7%. The American Diabetes Association recommends a goal of less than 7.0%, but that’s only met by approximately 20% of people with type 1 diabetes, according to a 2019 study.
Other types of artificial pancreas exist, but they typically require the user to input information before they will deliver insulin, including the amount of carbohydrates they ate in their last meal. Instead, the iLet takes the user’s weight and the type of meal they’re eating, such as breakfast, lunch, or dinner, added by the user via the iLet interface, and it uses an adaptive learning algorithm to deliver insulin automatically.