Mixing things up: Optimizing fluid mixing with machine learning
Mixing of fluids is a critical component in many industrial and chemical processes. Pharmaceutical mixing and chemical reactions, for instance, may require homogeneous fluid mixing. Achieving this mixing faster and with less energy would reduce the associated costs greatly. In reality, however, most mixing processes are not mathematically optimized and instead rely on trial-and-error-based empirical methods. Turbulent mixing, which uses turbulence to mix up fluids, is an option but is problematic as it is either difficult to sustain (such as in micro-mixers) or damages the materials being mixed (such as in bioreactors and food mixers).
Can an optimized mixing be achieved for laminar flows instead? To answer this question, a team of researchers from Japan, in a new study, turned to machine learning. In their study published in Scientific Reports, the team resorted to an approach called “reinforcement learning” (RL), in which intelligent agents take actions in an environment to maximize the cumulative reward (as opposed to an instantaneous reward).
“Since RL maximizes the cumulative reward, which is global-in-time, it can be expected to be suitable fortackling the problem of efficient fluid mixing, which is also a global-in-time optimization problem,” explains Associate Professor Masanobu Inubushi, the corresponding author of the study. “Personally, I have a conviction that it is important to find the right algorithm for the right problem rather than blindly apply a machine learning algorithm. Luckily, in this study, we managed to connect the two fields (fluid mixing and reinforcement learning) after considering their physical and mathematical characteristics.” The work included contributions from Mr. Mikito Konishi, a graduate student, and Prof. Susumu Goto, both from Osaka University.
One major roadblock awaited the team, however. While RL is suitable for global optimization problems, it is not particularly well-suited for systems involving high-dimensional state spaces, i.e., systems requiring a large number of variables for their description. Unfortunately, fluid mixing was just such a system.
To address this issue, the team adopted an approach used in the formulation of another optimization problem, which enabled them to reduce the state space dimension for fluid flow to one. Put simply, the fluid motion could now be described using only a single parameter!
The RL algorithm is usually formulated in terms of a “Markov decision process” (MDP), a mathematical framework for decision making in situations where the outcomes are part random and part controlled by the decision maker. Using this approach, the team showed that RL was effective in optimizing fluid mixing. More