Aurelia Butler

As any driver knows, accidents can happen in the blink of an eye — so when it comes to the camera system in autonomous vehicles, processing time is critical. The time that it takes for the system to snap an image and deliver the data to the microprocessor for image processing could mean the difference between avoiding an obstacle or getting into a major accident.
In-sensor image processing, in which important features are extracted from raw data by the image sensor itself instead of the separate microprocessor, can speed up the visual processing. To date, demonstrations of in-sensor processing have been limited to emerging research materials which are, at least for now, difficult to incorporate into commercial systems.
Now, researchers from the Harvard John A. Paulson School of Engineering and Applied Sciences (SEAS) have developed the first in-sensor processor that could be integrated into commercial silicon imaging sensor chips — known as complementary metal-oxide-semiconductor (CMOS) image sensors — that are used in nearly all commercial devices that need capture visual information, including smartphones.
The research is published in Nature Electronics.
“Our work can harnesses the mainstream semiconductor electronics industry to rapidly bring in-sensor computing to a wide variety of real-world applications,” said Donhee Ham, the Gordon McKay Professor of Electrical Engineering and Applied Physics at SEAS and senior author of the paper.
Ham and his team developed a silicon photodiode array. Commercially-available image sensing chips also have a silicon photodiode array to capture images, but the team’s photodiodes are electrostatically doped, meaning that sensitivity of individual photodiodes, or pixels, to incoming light can be tuned by voltages. An array that connects multiple voltage-tunable photodiodes together can perform an analog version of multiplication and addition operations central to many image processing pipelines, extracting the relevant visual information as soon as the image is captured.
“These dynamic photodiodes can concurrently filter images as they are captured, allowing for the first stage of vision processing to be moved from the microprocessor to the sensor itself,” said Houk Jang, a postdoctoral fellow at SEAS and first author of the paper.
The silicon photodiode array can be programmed into different image filters to remove unnecessary details or noise for various applications. An imaging system in an autonomous vehicle, for example, may call for a high-pass filter to track lane markings, while other applications may call for a filter that blurs for noise reduction.
“Looking ahead, we foresee the use of this silicon-based in-sensor processor not only in machine vision applications, but also in bio-inspired applications, wherein early information processing allows for the co-location of sensor and compute units, like in the brain,” said Henry Hinton, a graduate student at SEAS and co-first author of the paper.
Next, the team aims to increase the density of photodiodes and integrate them with silicon integrated circuits.
“By replacing the standard non-programmable pixels in commercial silicon image sensors with the programmable ones developed here, imaging devices can intelligently trim out unneeded data, thus could be made more efficient in both energy and bandwidth to address the demands of the next generation of sensory applications,” said Jang.
The research was co-authored by Woo-Bin Jung, Min-Hyun Lee, Changhyun Kim, Min Park, Seoung-Ki Lee and Seongjun Park. It was supported by the Samsung Advanced Institute of Technology under Contract A30216 and by the National Science Foundation Science and Technology Center for Integrated Quantum Materials under Contract DMR-1231319. More

In a molecular feat akin to getting pedestrians in a scramble crosswalk to spontaneously start walking in step, researchers at Kyushu University have created a series of molecules that tend to face the same direction to form a ‘giant surface potential’ when evaporated onto a surface.
The researchers hope to utilize the approach to generate controlled electric fields that help improve the efficiency of organic light-emitting diodes used in displays and lighting and open new routes for realizing devices that convert vibrations into electricity with organic materials.
Based on the fantastic chemical versatility of carbon that makes living organisms possible, organic electronics are already driving a wave of vibrant — and even flexible — smartphone and television screens, with applications in solar cells, lasers, and circuits on the horizon.
This flexibility is in part due to the disordered nature of the thin films of the materials used in the devices. Unlike common inorganic electronics based on silicon atoms tightly connected in rigid, well-organized crystals, organics usually form ‘amorphous’ layers that are not nearly as neatly organized.
Despite the seemingly random organization of the molecules, researchers have found that some in fact tend to align in similar directions, profoundly impacting the properties of a device and creating new possibilities for controlling device performance.
“Significant work has already been done on molecules that align in a way that the light they emit can more easily escape a device,” says Masaki Tanaka, an assistant professor at Tokyo University of Agriculture and Technology (TUAT) who started the present work while at Kyushu University’s Center for Organic Photonics and Electronics Research (OPERA) and continued further study of the molecular alignment in amorphous films after his transfer to TUAT. More

Parkinson’s disease is notoriously difficult to diagnose as it relies primarily on the appearance of motor symptoms such as tremors, stiffness, and slowness, but these symptoms often appear several years after the disease onset. Now, Dina Katabi, the Thuan (1990) and Nicole Pham Professor in the Department of Electrical Engineering and Computer Science (EECS) at MIT and principal investigator at MIT Jameel Clinic, and her team have developed an artificial intelligence model that can detect Parkinson’s just from reading a person’s breathing patterns.
The tool in question is a neural network, a series of connected algorithms that mimic the way a human brain works, capable of assessing whether someone has Parkinson’s from their nocturnal breathing — i.e., breathing patterns that occur while sleeping. The neural network, which was trained by MIT PhD student Yuzhe Yang and postdoc Yuan Yuan, is also able to discern the severity of someone’s Parkinson’s disease and track the progression of their disease over time.
Yang is first author on a new paper describing the work, published today in Nature Medicine. Katabi, who is also an affiliate of the MIT Computer Science and Artificial Intelligence Laboratory and director of the Center for Wireless Networks and Mobile Computing, is the senior author. They are joined by Yuan and 12 colleagues from Rutgers University, the University of Rochester Medical Center, the Mayo Clinic, Massachusetts General Hospital, and the Boston University College of Health and Rehabilition.
Over the years, researchers have investigated the potential of detecting Parkinson’s using cerebrospinal fluid and neuroimaging, but such methods are invasive, costly, and require access to specialized medical centers, making them unsuitable for frequent testing that could otherwise provide early diagnosis or continuous tracking of disease progression.
The MIT researchers demonstrated that the artificial intelligence assessment of Parkinson’s can be done every night at home while the person is asleep and without touching their body. To do so, the team developed a device with the appearance of a home Wi-Fi router, but instead of providing internet access, the device emits radio signals, analyzes their reflections off the surrounding environment, and extracts the subject’s breathing patterns without any bodily contact. The breathing signal is then fed to the neural network to assess Parkinson’s in a passive manner, and there is zero effort needed from the patient and caregiver.
“A relationship between Parkinson’s and breathing was noted as early as 1817, in the work of Dr. James Parkinson. This motivated us to consider the potential of detecting the disease from one’s breathing without looking at movements,” Katabi says. “Some medical studies have shown that respiratory symptoms manifest years before motor symptoms, meaning that breathing attributes could be promising for risk assessment prior to Parkinson’s diagnosis.”
The fastest-growing neurological disease in the world, Parkinson’s is the second-most common neurological disorder, after Alzheimer’s disease. In the United States alone, it afflicts over 1 million people and has an annual economic burden of $51.9 billion. The research team’s algorithm was tested on 7,687 individuals, including 757 Parkinson’s patients.
Katabi notes that the study has important implications for Parkinson’s drug development and clinical care. “In terms of drug development, the results can enable clinical trials with a significantly shorter duration and fewer participants, ultimately accelerating the development of new therapies. In terms of clinical care, the approach can help in the assessment of Parkinson’s patients in traditionally underserved communities, including those who live in rural areas and those with difficulty leaving home due to limited mobility or cognitive impairment,” she says.
“We’ve had no therapeutic breakthroughs this century, suggesting that our current approaches to evaluating new treatments is suboptimal,” says Ray Dorsey, a professor of neurology at the University of Rochester and Parkinson’s specialist who co-authored the paper. Dorsey adds that the study is likely one of the largest sleep studies ever conducted on Parkinson’s. “We have very limited information about manifestations of the disease in their natural environment and [Katabi’s] device allows you to get objective, real-world assessments of how people are doing at home. The analogy I like to draw [of current Parkinson’s assessments] is a street lamp at night, and what we see from the street lamp is a very small segment … [Katabi’s] entirely contactless sensor helps us illuminate the darkness.”
This research was performed in collaboration with the University of Rochester, Mayo Clinic, and Massachusetts General Hospital, and is sponsored by the National Institutes of Health, with partial support by the National Science Foundation and the Michael J. Fox Foundation.
Story Source:
Materials provided by Massachusetts Institute of Technology. Original written by Alex Ouyang, Abdul Latif Jameel Clinic for Machine Learning in Health. Note: Content may be edited for style and length. More

They’re everywhere, from Berlin to Beijing, brightly coloured bicycles you can borrow to move around the city without a car. These systems, along with e-scooters, offer people a quick and convenient way to travel around urban areas. And at a time when cities are scrambling to find ways to meet their climate goals, they’re a welcome tool for urban planners.
Making sure the bikes and e-scooters are on hand can be something of a challenge — but it’s also key to the success of the offer, says Steffen Bakker, a researcher at NTNU’s Department of Industrial Economic and Technology Management who studies ways to make transport greener and more efficient.
“If a system like this is going to be successful, then we need to have user satisfaction,” Bakker said. “People want the bikes to be there when they want to use them, and they will only want to use the system if it’s a good service.”
Bakker was a co-author on a recent paper that describes an optimization model to help cities and companies do a better job keeping their bike-sharing customers happy.
Like shooting a moving target
Consider the challenges of providing bikes or scooters where and when people will want them. More

Tungsten di-telluride (WTe2) has recently proven to be a promising material for the realization of topological states. These are regarded as the key to novel “spintronic” devices and quantum computers of the future due to their unique electronic properties. Physicists at Forschungszentrum Jülich have now been able to understand for the first time how the topological properties of multilayer WTe2 systems can be changed systematically by means of studies under a scanning tunneling microscope. The results have been published in the journal Nano Letters.
Topological insulators became known beyond expert circles thanks to the 2016 Nobel Prize in Physics. However, their research is still quite in its beginnings, and many fundamental questions remain unanswered. One of the distinguishing features of the compound WTe2 is that it exhibits a whole range of exotic physical phenomena depending on its layer thickness. Atomically thin layers are insulating on the surface, but due to their crystal structure they exhibit so-called topologically protected edge channels. These edge channels are electrically conductive and the conduction depends on the spin of the electrons. If two such layers are stacked on top of each other, crucially different interactions occur depending on how the layers are aligned.
If the two layers are not aligned, the conductive edge channels in the two layers interact only minimally. However, if they are twisted by exactly 180°, the topological protection as well as the edge channels disappear and the entire system becomes insulating. Furthermore, with a minimal twist of only a few degrees, a periodic superstructure, a so-called moiré lattice, forms, which additionally modulates the electrical conductivity. Researchers at the Peter Grünberg Institute (PGI-3) have now been able to study these properties locally on the atomic scale for the first time using a scanning tunneling microscope giving crucial insights into the interactions between the layers.
Story Source:
Materials provided by Forschungszentrum Juelich. Note: Content may be edited for style and length. More

Short animations giving viewers a taste of the tactics behind misinformation can help to “inoculate” people against harmful content on social media when deployed in YouTube’s advert slot, according to a major online experiment led by the University of Cambridge.
Working with Jigsaw (https://jigsaw.google.com/), a unit within Google dedicated to tackling threats to open societies, a team of psychologists from the universities of Cambridge and Bristol created 90-second clips designed to familiarise users with manipulation techniques such as scapegoating and deliberate incoherence.
This “pre-bunking” strategy pre-emptively exposes people to tropes at the root of malicious propaganda, so they can better identify online falsehoods regardless of subject matter.
Researchers behind the Inoculation Science project (https://inoculation.science/) compare it to a vaccine: by giving people a “micro-dose” of misinformation in advance, it helps prevent them falling for it in future — an idea based on what social psychologist’s call “inoculation theory.”
The findings, published in Science Advances, come from seven experiments involving a total of almost 30,000 participants — including the first “real world field study” of inoculation theory on a social media platform — and show a single viewing of a film clip increases awareness of misinformation.
The videos introduce concepts from the “misinformation playbook,” illustrated with relatable examples from film and TV such as Family Guy or, in the case of false dichotomies, Star Wars (“Only a Sith deals in absolutes”). More

Lung cancer, the most common cancer worldwide, is targeted with radiation therapy (RT) in nearly one-half of cases. RT planning is a manual, resource-intensive process that can take days to weeks to complete, and even highly trained physicians vary in their determinations of how much tissue to target with radiation. Furthermore, a shortage of radiation-oncology practitioners and clinics worldwide is expected to grow as cancer rates increase. Brigham and Women’s Hospital researchers and collaborators, working under the Artificial Intelligence in Medicine Program of Mass General Brigham, developed and validated a deep learning algorithm that can identify and outline (“segment”) a non-small cell lung cancer (NSCLC) tumor on a computed tomography (CT) scan within seconds. Their research, published in Lancet Digital Health, also demonstrates that radiation oncologists using the algorithm in simulated clinics performed as well as physicians not using the algorithm, while working 65 percent more quickly.
“The biggest translation gap in AI applications to medicine is the failure to study how to use AI to improve human clinicians, and vice versa,” said corresponding author Raymond Mak, MD, of the Brigham’s Department of Radiation Oncology. “We’re studying how to make human-AI partnerships and collaborations that result in better outcomes for patients. The benefits of this approach for patients include greater consistency in segmenting tumors and accelerated times to treatment. The clinician benefits include a reduction in mundane but difficult computer work, which can reduce burnout and increase the time they can spend with patients.”
The researchers used CT images from 787 patients to train their model to distinguish tumors from other tissues. They tested the algorithm’s performance using scans from over 1,300 patients from increasingly external datasets. Developing and validating the algorithm involved close collaboration between data scientists and radiation oncologists. For example, when the researchers observed that the algorithm was incorrectly segmenting CT scans involving the lymph nodes, they retrained the model with more of these scans to improve its performance.
Finally, the researchers asked eight radiation oncologists to perform segmentation tasks as well as rate and edit segmentations produced by either another expert physician or the algorithm (they were not told which). There was no significant difference in performance between human-AI collaborations and human-produced (de novo) segmentations. Intriguingly, physicians worked 65 percent faster and with 32 percent less variation when editing an AI-produced segmentation compared to a manually produced one, even though they were unaware of which one they were editing. They also rated the quality of AI-drawn segmentations more highly than the human expert-drawn segmentations in this blinded study.
Going forward, the researchers plan to combine this work with AI models they designed previously that can identify “organs at risk” of receiving undesired radiation during cancer treatment (such as the heart) and thereby exclude them from radiotherapy. They are continuing to study how physicians interact with AI to ensure that AI-partnerships help, rather than harm, clinical practice, and are developing a second, independent segmentation algorithm that can verify both human and AI-drawn segmentations.
“This study presents a novel evaluation strategy for AI models that emphasizes the importance of human-AI collaboration,” said co-author Hugo Aerts, PhD, of the Department of Radiation Oncology. “This is especially necessary because in silico (computer-modeled) evaluations can give different results than clinical evaluations. Our approach can help pave the way towards clinical deployment.”
This study was funded by the National Institutes of Health (U24CA194354, U01CA190234, and U01CA209414).
Story Source:
Materials provided by Brigham and Women’s Hospital. Note: Content may be edited for style and length. More

Researchers from RIKEN in Japan have achieved a major step toward large-scale quantum computing by demonstrating error correction in a three-qubit silicon-based quantum computing system. This work, published in Nature, could pave the way toward the achievement of practical quantum computers.
Quantum computers are a hot area of research today, as they promise to make it possible to solve certain important problems that are intractable using conventional computers. They use a completely different architecture, using superimposition states found in quantum physics rather than the simple 1 or 0 binary bits used in conventional computers. However, because they are designed in a completely different way, they are very sensitive to environmental noise and other issues, such as decoherence, and require error correction to allow them to do precise calculations.
One important challenge today is choosing what systems can best act as “qubits”–the basic units used to make quantum calculations. Different candidate systems have their own strengths and weaknesses. Some of the popular systems today include superconducting circuits and ions, which have the advantage that some form of error correction has been demonstrated, allowing them to be put into actual use albeit on a small scale. Silicon-based quantum technology, which has only begun to be developed over the past decade, is known to have an advantage in that it utilizes a semiconductor nanostructure similar to what is commonly used to integrate billions of transistors in a small chip, and therefore could take advantage of current production technology.
However, one major problem with the silicon-based technology is that there is a lack of technology for error connection. Researchers have previously demonstrated control of two qubits, but that is not enough for error correction, which requires a three-qubit system.
In the current research, conducted by researchers at the RIKEN Center for Emergent Matter Science and the RIKEN Center for Quantum Computing, the group achieved this feat, demonstrating full control of a three-qubit system (one of the largest qubit systems in silicon), thus providing a prototype for the first time of quantum error correction in silicon. They achieved this by implementing a three-qubit Toffoli-type quantum gate.
According to Kenta Takeda, the first author of the paper, “The idea of implementing a quantum error-correcting code in quantum dots was proposed about a decade ago, so it is not an entirely new concept, but a series of improvements in materials, device fabrication, and measurement techniques allowed us to succeed in this endeavor. We are very happy to have achieved this.”
According to Seigo Tarucha, the leader of the research group, “Our next step will be to scale up the system. We think scaling up is the next step. For that, it would be nice to work with semiconductor industry groups capable of manufacturing silicon-based quantum devices at a large scale.
Story Source:
Materials provided by RIKEN. Note: Content may be edited for style and length. More