More stories

  • in

    Machine learning gives users ‘superhuman’ ability to open and control tools in virtual reality

    Researchers have developed a virtual reality application where a range of 3D modelling tools can be opened and controlled using just the movement of a user’s hand.
    The researchers, from the University of Cambridge, used machine learning to develop ‘HotGestures’ — analogous to the hot keys used in many desktop applications.
    HotGestures give users the ability to build figures and shapes in virtual reality without ever having to interact with a menu, helping them stay focused on a task without breaking their train of thought.
    The idea of being able to open and control tools in virtual reality has been a movie trope for decades, but the researchers say that this is the first time such a ‘superhuman’ ability has been made possible. The results are reported in the journal IEEE Transactions on Visualization and Computer Graphics.
    Virtual reality (VR) and related applications have been touted as game-changers for years, but outside of gaming, their promise has not fully materialised. “Users gain some qualities when using VR, but very few people want to use it for an extended period of time,” said Professor Per Ola Kristensson from Cambridge’s Department of Engineering, who led the research. “Beyond the visual fatigue and ergonomic issues, VR isn’t really offering anything you can’t get in the real world.”
    Most users of desktop software will be familiar with the concept of hot keys — command shortcuts such as ctrl-c to copy and ctrl-v to paste. While these shortcuts omit the need to open a menu to find the right tool or command, they rely on the user having the correct command memorised.
    “We wanted to take the concept of hot keys and turn it into something more meaningful for virtual reality — something that wouldn’t rely on the user having a shortcut in their head already,” said Kristensson, who is also co-Director of the Centre for Human-Inspired Artificial Intelligence. More

  • in

    Neuromorphic computing will be great… if hardware can handle the workload

    Technology is edging closer and closer to the super-speed world of computing with artificial intelligence. But is the world equipped with the proper hardware to be able to handle the workload of new AI technological breakthroughs?
    “The brain-inspired codes of the AI revolution are largely being run on conventional silicon computer architectures which were not designed for it,” explains Erica Carlson, 150th Anniversary Professor of Physics and Astronomy at Purdue University.
    A joint effort between Physicists from Purdue University, University of California San Diego (USCD) and École Supérieure de Physique et de Chimie Industrielles (ESPCI) in Paris, France, believe they may have discovered a way to rework the hardware…. By mimicking the synapses of the human brain. They published their findings, “Spatially Distributed Ramp Reversal Memory in VO2” in Advanced Electronic Materials which is featured on the back cover of the October 2023 edition.
    New paradigms in hardware will be necessary to handle the complexity of tomorrow’s computational advances. According to Carlson, lead theoretical scientist of this research, “neuromorphic architectures hold promise for lower energy consumption processors, enhanced computation, fundamentally different computational modes, native learning and enhanced pattern recognition.”
    Neuromorphic architecture basically boils down to computer chips mimicking brain behavior. Neurons are cells in the brain that transmit information. Neurons have small gaps at their ends that allow signals to pass from one neuron to the next which are called synapses. In biological brains, these synapses encode memory. This team of scientists concludes that vanadium oxides show tremendous promise for neuromorphic computing because they can be used to make both artificial neurons and synapses.
    “The dissonance between hardware and software is the origin of the enormously high energy cost of training, for example, large language models like ChatGPT,” explains Carlson. “By contrast, neuromorphic architectures hold promise for lower energy consumption by mimicking the basic components of a brain: neurons and synapses. Whereas silicon is good at memory storage, the material does not easily lend itself to neuron-like behavior. Ultimately, to provide efficient, feasible neuromorphic hardware solutions requires research into materials with radically different behavior from silicon — ones that can naturally mimic synapses and neurons. Unfortunately, the competing design needs of artificial synapses and neurons mean that most materials that make good synaptors fail as neuristors, and vice versa. Only a handful of materials, most of them quantum materials, have the demonstrated ability to do both.”
    The team relied on a recently discovered type of non-volatile memory which is driven by repeated partial temperature cycling through the insulator-to-metal transition. This memory was discovered in vanadium oxides. More

  • in

    Lightening the load: Researchers develop autonomous electrochemistry robot

    Researchers at the Beckman Institute for Advanced Science and Technology developed an automated laboratory robot to run complex electrochemical experiments and analyze data.
    With affordability and accessibility in mind, the researchers collaboratively created a benchtop robot that rapidly performs electrochemistry. Aptly named the Electrolab, this instrument greatly reduces the effort and time needed for electrochemical studies by automating many basic and repetitive laboratory tasks.
    The Electrolab can be used to explore energy storage materials and chemical reactions that promote the use of alternative and renewable power sources like solar or wind energy, which are essential to combating climate change.
    “We hope the Electrolab will allow new discoveries in energy storage while helping us share knowledge and data with other electrochemists — and non-electrochemists! We want them to be able to try things they couldn’t before,” said Joaquín Rodríguez-López, a professor in the Department of Chemistry at the University of Illinois Urbana-Champaign.
    The interdisciplinary team was co-led by Rodríguez-López and Charles Schroeder, the James Economy professor in the Department of Materials Science and Engineering and a professor of chemical and biomolecular engineering at UIUC. Their work appears in the journal Device.
    Electrochemistry is the study of electricity and its relation to chemistry. Chemical reactions release energy that can be converted into electricity — batteries used to power remote controllers or electric vehicles are perfect examples of this phenomenon.
    In the opposite direction, electricity can also be used to drive chemical reactions. Electrochemistry can provide a green and sustainable alternative to many reactions that would otherwise require the use of harsh chemicals, and it can even drive chemical reactions that convert greenhouse gasses such as carbon dioxide into chemicals that are useful in other industries. These are relatively simple demonstrations of electrochemistry, but the growing demand to generate and store massive amounts of energy on a much larger scale is currently a prominent challenge. More

  • in

    450-million-year-old organism finds new life in Softbotics

    Researchers in the Department of Mechanical Engineering at Carnegie Mellon University, in collaboration with paleontologists from Spain and Poland, used fossil evidence to engineer a soft robotic replica of pleurocystitid, a marine organism that existed nearly 450 million years ago and is believed to be one of the first echinoderms capable of movement using a muscular stem.
    Published today in The Proceedings of the National Academy of Science (PNAS), the research seeks to broaden modern perspective of animal design and movement by introducing a new a field of study — Paleobionics — aimed at using Softbotics, robotics with flexible electronics and soft materials, to understand the biomechanical factors that drove evolution using extinct organisms.
    “Softbotics is another approach to inform science using soft materials to construct flexible robot limbs and appendages. Many fundamental principles of biology and nature can only fully be explained if we look back at the evolutionary timeline of how animals evolved. We are building robot analogues to study how locomotion has changed,” said Carmel Majidi, lead author and Professor of Mechanical Engineering at Carnegie Mellon University.
    With humans’ time on earth representing only 0.007% of the planet’s history, the modern-day animal kingdom that influences understanding of evolution and inspires today’s mechanical systems is only a fraction of all creatures that have existed through history.
    Using fossil evidence to guide their design and a combination of 3D printed elements and polymers to mimic the flexible columnar structure of the moving appendage, the team demonstrated that pleurocystitids were likely able to move over the sea bottom by means of a muscular stem that pushed the animal forward. Despite the absence of a current day analogue (echinoderms have since evolved to include modern day starfish and sea urchins), pleurocystitids have been of interest to paleontologists due to their pivotal role in echinoderm evolution.
    The team determined that wide sweeping movements were likely the most effective motion and that increasing the length of the stem significantly increased the animals’ speed without forcing it to exert more energy.
    “Researchers in the bio-inspired robotics community need to pick and choose important features worth adopting from organisms,” explained Richard Desatnik, PhD candidate and co-first author. More

  • in

    Artificial intelligence may help predict — possibly prevent — sudden cardiac death

    Predicting sudden cardiac death, and perhaps even addressing a person’s risk to prevent future death, may be possible through artificial intelligence (AI) and could offer a new move toward prevention and global health strategies, according to preliminary research to be presented at the American Heart Association’s Resuscitation Science Symposium 2023. The meeting, Nov. 11-12, in Philadelphia is a premier global exchange of the most recent advances related to treating cardiopulmonary arrest and life-threatening traumatic injury.
    “Sudden cardiac death, a public health burden, represents 10% to 20% of overall deaths. Predicting it is difficult, and the usual approaches fail to identify high-risk people, particularly at an individual level,” said Xavier Jouven, M.D., Ph.D., the lead author of the study and professor of cardiology and epidemiology at the Paris Cardiovascular Research Center, Inserm U970-University of Paris. “We proposed a new approach not restricted to the usual cardiovascular risk factors but encompassing all medical information available in electronic health records.”
    The research team analyzed medical information with AI from registries and databases in Paris, France and Seattle for 25,000 people who had died from sudden cardiac arrest and 70,000 people from the general population, with data from the two groups matched by age, sex and residential area. The data, which represented more than 1 million hospital diagnoses and 10 million medication prescriptions, was gathered from medical records up to ten years prior to each death. Using AI to analyze the data, researchers built nearly 25,000 equations with personalized health factors used to identify those people who were at very high risk of sudden cardiac death. Additionally, they developed a customized risk profile for each of the individuals in the study.
    The personalized risk equations included a person’s medical details, such as treatment for high blood pressure and history of heart disease, as well as mental and behavioral disorders including alcohol abuse. The analysis identified those factors most likely to decrease or increase the risk of sudden cardiac death at a particular percentage and time frame, for example, 89% risk of sudden cardiac death within three months.
    The AI analysis was able to identify people who had more than 90% of risk to die suddenly, and they represented more than one fourth of all cases of sudden cardiac death.
    “We have been working for almost 30 years in the field of sudden cardiac death prediction, however, we did not expect to reach such a high level of accuracy. We also discovered that the personalized risk factors are very different between the participants and are often issued from different medical fields (a mix of neurological, psychiatric, metabolic and cardiovascular data) — a picture difficult to catch for the medical eyes and brain of a specialist in one given field” said Jouven, who is also founder of the Paris Sudden Death Expertise Center. “While doctors have efficient treatments such as correction of risk factors, specific medications and implantable defibrillators, the use of AI is necessary to detect in a given subject a succession of medical information registered over the years that will form a trajectory associated with an increased risk of sudden cardiac death. We hope that with a personalized list of risk factors, patients will be able to work with their clinicians to reduce those risk factors and ultimately decrease the potential for sudden cardiac death.”
    Among the study’s limitations are the potential use of the prediction models beyond this research. In addition, the medical data collected in electronic health records sometimes include proxies instead of raw data, and the data collected may be different among countries, requiring an adaptation of the prediction models. More

  • in

    Brain implant may enable communication from thoughts alone

    A speech prosthetic developed by a collaborative team of Duke neuroscientists, neurosurgeons, and engineers can translate a person’s brain signals into what they’re trying to say.
    Appearing Nov. 6 in the journal Nature Communications, the new technology might one day help people unable to talk due to neurological disorders regain the ability to communicate through a brain-computer interface.
    “There are many patients who suffer from debilitating motor disorders, like ALS (amyotrophic lateral sclerosis) or locked-in syndrome, that can impair their ability to speak,” said Gregory Cogan, Ph.D., a professor of neurology at Duke University’s School of Medicine and one of the lead researchers involved in the project. “But the current tools available to allow them to communicate are generally very slow and cumbersome.”
    Imagine listening to an audiobook at half-speed. That’s the best speech decoding rate currently available, which clocks in at about 78 words per minute. People, however, speak around 150 words per minute.
    The lag between spoken and decoded speech rates is partially due the relatively few brain activity sensors that can be fused onto a paper-thin piece of material that lays atop the surface of the brain. Fewer sensors provide less decipherable information to decode.
    To improve on past limitations, Cogan teamed up with fellow Duke Institute for Brain Sciences faculty member Jonathan Viventi, Ph.D., whose biomedical engineering lab specializes in making high-density, ultra-thin, and flexible brain sensors.
    For this project, Viventi and his team packed an impressive 256 microscopic brain sensors onto a postage stamp-sized piece of flexible, medical-grade plastic. Neurons just a grain of sand apart can have wildly different activity patterns when coordinating speech, so it’s necessary to distinguish signals from neighboring brain cells to help make accurate predictions about intended speech. More

  • in

    Collective intelligence can help reduce medical misdiagnoses

    Researchers from the Max Planck Institute for Human Development, the Institute for Cognitive Sciences and Technologies (ISTC), and the Norwegian University of Science and Technology developed a collective intelligence approach to increase the accuracy of medical diagnoses. Their work was recently presented in the journal PNAS.
    An estimated 250,000 people die from preventable medical errors in the U.S. each year. Many of these errors originate during the diagnostic process. A powerful way to increase diagnostic accuracy is to combine the diagnoses of multiple diagnosticians into a collective solution. However, there has been a dearth of methods for aggregating independent diagnoses in general medical diagnostics. Researchers from the Max Planck Institute for Human Development, the Institute for Cognitive Sciences and Technologies (ISTC), and the Norwegian University of Science and Technology have therefore introduced a fully automated solution using knowledge engineering methods.
    The researchers tested their solution on 1,333 medical cases provided by The Human Diagnosis Project (Human Dx), each of which was independently diagnosed by 10 diagnosticians. The collective solution substantially increased diagnostic accuracy: Single diagnosticians achieved 46% accuracy, whereas pooling the decisions of 10 diagnosticians increased accuracy to 76%. Improvements occurred across medical specialties, chief complaints, and diagnosticians’ tenure levels. “Our results show the life-saving potential of tapping into the collective intelligence,” says first author Ralf Kurvers. He is a senior research scientist at the Center for Adaptive Rationality of the Max Planck Institute for Human Development and his research focuses on social and collective decision making in humans and animals.
    Collective intelligence has been proven to boost decision accuracy across many domains, such as geopolitical forecasting, investment, and diagnostics in radiology and dermatology (e.g., Kurvers et al., PNAS, 2016). However, collective intelligence has been mostly applied to relatively simple decision tasks. Applications in more open-ended tasks, such as emergency management or general medical diagnostics, are largely lacking due to the challenge of integrating unstandardized inputs from different people. To overcome this hurdle, the researchers used semantic knowledge graphs, natural language processing, and the SNOMED CT medical ontology, a comprehensive multilingual clinical terminology, for standardization.
    “A key contribution of our work is that, while the human-provided diagnoses maintain their primacy, our aggregation and evaluation procedures are fully automated, avoiding possible biases in the generation of the final diagnosis and allowing the process to be more time- and cost-efficient,” adds co-author Vito Trianni from the Institute for Cognitive Sciences and Technologies (ISTC) in Rome.
    The researchers are currently collaborating — along with other partners — within the HACID project to bring their application one step closer to the market. The EU-funded project will explore a new approach that brings together human experts and AI-supported knowledge representation and reasoning in order to create new tools for decision making in various domains. The application of the HACID technology to medical diagnostics showcases one of the many opportunities to benefit from a digitally based health system and accessible data. More

  • in

    Photo battery achieves competitive voltage

    Researchers from the Universities of Freiburg and Ulm have developed a monolithically integrated photo battery using organic materials.
    Networked intelligent devices and sensors can improve the energy efficiency of consumer products and buildings by monitoring their consumption in real time. Miniature devices like these being developed under the concept of the Internet of Things require energy sources that are as compact as possible in order to function autonomously. Monolithically integrated batteries that simultaneously generate, convert, and store energy in a single system could be used for this purpose.
    A team of scientists at the University of Freiburg’s Cluster of Excellence Living, Adaptive, and Energy-Autonomous Materials Systems (livMatS) has developed a monolithically integrated photo battery consisting of an organic polymer-based battery and a multi-junction organic solar cell. The battery, presented by Rodrigo Delgado Andrés andDr. Uli Würfel, University Freiburg, and Robin Wessling and Prof. Dr. Birgit Esser, University of Ulm, is the first monolithically integrated photo battery made of organic materials to achieve a discharge potential of 3.6 volts. It is thus among the first systems of this kind capable of powering miniature devices. The team published their results in the journal Energy & Environmental Science.
    Combination of a multi-junction solar cell and a dual-ion battery
    The researchers developed a scalable method for the photo battery which allows them to manufacture organic solar cells out of five active layers. “The system achieves relatively high voltages of 4.2 volts with this solar cell,” explains Wessling. The team combined this multi-junction solar cell with a so-called dual-ion battery, which is capable of being charged at high currents, unlike the cathodes of conventional lithium batteries. With careful control of illumination intensity and discharge rates, a photo battery constructed in this way is capable of rapid charging in less than 15 minutes at discharge capacities of up to 22 milliampere hours per gram (mAh g-1). In combination with the averaged discharge potential of 3.6 volts, the devices can provide an energy density of 69 milliwatt hours per gram (mWh g-1) and a power density of 95 milliwatts per gram (mW g-1). “Our system thus lays the foundation for more in-depth research and further developments in the area of organic photo batteries,” says Wessling. More