<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="research-article" dtd-version="2.3" xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Chem.</journal-id>
<journal-title>Frontiers in Chemistry</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Chem.</abbrev-journal-title>
<issn pub-type="epub">2296-2646</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">818230</article-id>
<article-id pub-id-type="doi">10.3389/fchem.2022.818230</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Chemistry</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Early Detection of Nucleation Events From Solution in LC-TEM by Machine Learning</article-title>
<alt-title alt-title-type="left-running-head">Katsuno et&#x20;al.</alt-title>
<alt-title alt-title-type="right-running-head">Early Detection by Machine Learning</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Katsuno</surname>
<given-names>Hiroyasu</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
<uri xlink:href="https://loop.frontiersin.org/people/1379874/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Kimura</surname>
<given-names>Yuki</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/300409/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Yamazaki</surname>
<given-names>Tomoya</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/1376112/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Takigawa</surname>
<given-names>Ichigaku</given-names>
</name>
<xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref>
<xref ref-type="aff" rid="aff3">
<sup>3</sup>
</xref>
</contrib>
</contrib-group>
<aff id="aff1">
<sup>1</sup>
<institution>Institute of Low Temperature Science</institution>, <institution>Hokkaido University</institution>, <addr-line>Sapporo</addr-line>, <country>Japan</country>
</aff>
<aff id="aff2">
<sup>2</sup>
<institution>RIKEN, Center for Advanced Intelligence Project</institution>, <addr-line>Tokyo</addr-line>, <country>Japan</country>
</aff>
<aff id="aff3">
<sup>3</sup>
<institution>Institute for Chemical Reaction Design and Discovery (WPI-ICReDD)</institution>, <institution>Hokkaido University</institution>, <addr-line>Sapporo</addr-line>, <country>Japan</country>
</aff>
<author-notes>
<fn fn-type="edited-by">
<p>
<bold>Edited by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/761289/overview">Mingshui Yao</ext-link>, Kyoto University, Japan</p>
</fn>
<fn fn-type="edited-by">
<p>
<bold>Reviewed by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1568304/overview">Zhehao Huang</ext-link>, Stockholm University, Sweden</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1570014/overview">Xiongwei Ni</ext-link>, Heriot-Watt University, United&#x20;Kingdom</p>
</fn>
<corresp id="c001">&#x2a;Correspondence: Hiroyasu Katsuno, <email>katsuno@lowtem.hokudai.ac.jp</email>
</corresp>
<fn fn-type="other">
<p>This article was submitted to Nanoscience, a section of the journal Frontiers in Chemistry</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>24</day>
<month>01</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>10</volume>
<elocation-id>818230</elocation-id>
<history>
<date date-type="received">
<day>19</day>
<month>11</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>03</day>
<month>01</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2022 Katsuno, Kimura, Yamazaki and Takigawa.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Katsuno, Kimura, Yamazaki and Takigawa</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these&#x20;terms.</p>
</license>
</permissions>
<abstract>
<p>To support the detection, recording, and analysis of nucleation events during <italic>in situ</italic> observations, we developed an early detection system for nucleation events observed using a liquid-cell transmission electron microscope. Detectability was achieved using the machine learning equivalent of detection by humans watching a video numerous times. The detection system was applied to the nucleation of sodium chloride crystals from a saturated acetone solution of sodium chlorate. Nanoparticles with a radius of more greater than 150&#xa0;nm were detected in a viewing area of 12&#xa0;<italic>&#x3bc;</italic>m &#xd7; 12&#xa0;<italic>&#x3bc;</italic>m by the detection system. The analysis of the change in the size of the growing particles as a function of time suggested that the crystal phase of the particles with a radius smaller than 400&#xa0;nm differed from that of the crystals larger than 400&#xa0;nm. Moreover, the use of machine learning enabled the detection of numerous nanometer sized nuclei. The nucleation rate estimated from the machine-learning-based detection was of the same order as that estimated from the detection using manual procedures.</p>
</abstract>
<kwd-group>
<kwd>transmission electron microscopy</kwd>
<kwd>object detection</kwd>
<kwd>nucleation</kwd>
<kwd>machine learning</kwd>
<kwd>YOLOv5</kwd>
</kwd-group>
<contract-num rid="cn001">20H05657 21K03379</contract-num>
<contract-sponsor id="cn001">Japan Society for the Promotion of Science<named-content content-type="fundref-id">10.13039/501100001691</named-content>
</contract-sponsor>
</article-meta>
</front>
<body>
<sec id="s1">
<title>1 Introduction</title>
<p>The nucleation of crystals is the first stage of crystallization and the origin of all materials. Because materials have a wide range of applications, including metals, chemical compounds, and biological materials, numerous studies of the crystallization of materials have been conducted over the past 50&#xa0;years. The general understanding of crystallization is summarized in the classical nucleation theory (<xref ref-type="bibr" rid="B17">Markov, 2003</xref>). In the classical nucleation theory, only the exchange of single growth units is considered and there is only one nucleation pathway. The simple classical nucleation theory provides important basic concepts, such as a critical nucleus, and observable physical quantities, such as the nucleation rate. The validity of the nucleation theory on an atomic scale has been studied through the two-dimensional epitaxial growth of metals and semiconductors using a combination of molecular beam epitaxy and scanning probe microscopy (<xref ref-type="bibr" rid="B18">Michely and Krug, 2004</xref>).</p>
<p>Over the past decade, nonclassical nucleation phenomena in liquids have attracted attention of researchers because the proposed hypotheses are based on both experimental results (<xref ref-type="bibr" rid="B5">Yoreo et&#x20;al., 2015</xref>; <xref ref-type="bibr" rid="B14">Lee et&#x20;al., 2016</xref>; <xref ref-type="bibr" rid="B10">Ishizuka et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B26">Driessche et&#x20;al., 2018</xref>) and computational results (<xref ref-type="bibr" rid="B25">Tanaka et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B23">Takahashi et&#x20;al., 2021</xref>). Liquid cell transmission electron microscopy (LC-TEM) is a recently developed <italic>in situ</italic> observation method (<xref ref-type="bibr" rid="B4">de Jonge and Ross, 2011</xref>) that has been widely used to observe nanoscale objects in liquids. The spatial and temporal resolution of LC-TEM has been improved to atomic-scale observations (<xref ref-type="bibr" rid="B3">de Jonge et&#x20;al., 2019</xref>), similar to ordinary transmission electron microscopy (TEM) observation. Nevertheless, observing a moving object by TEM is difficult because the image changes from moment to moment. In general, one approach to obtaining a clear image is to minimize the exposure time by increasing the electron dose. The integration of an electron beam improves the signal-to-noise ratio; however, the electron beam might damage samples (<xref ref-type="bibr" rid="B6">Egerton et&#x20;al., 2004</xref>). In the case of LC-TEM, in particular, the solution degrades because of the radiolysis of the sample solution by the electron beam (<xref ref-type="bibr" rid="B20">Schneider et&#x20;al., 2014</xref>). The improvement by integration is not effective when the acquired image changes in response to beam effects. Observations in which the image changes, such as <italic>in situ</italic> observations, require clear images with a short exposure time. Thus, <italic>in situ</italic> observation requires a low-dose electron observation technique. Denoising methods based on sparse coding (<xref ref-type="bibr" rid="B1">Anada et&#x20;al., 2019</xref>) and a deep neural network (<xref ref-type="bibr" rid="B12">Katsuno et&#x20;al., 2021</xref>; <xref ref-type="bibr" rid="B27">Vincent et&#x20;al., 2021</xref>) have been developed in addition to ordinary methods, and these methods are expected to enable observations with a low dose of electrons in the future. However, there are a few issues specific to <italic>in situ</italic> observation. The same image cannot be acquired twice because the acquired image constantly changes, which introduces the difficultly in <italic>in situ</italic> observations of requiring the operator to decide immediately what to look for and where to look when acquiring an image. When the image acquisition fails, the same experiment must be repeated. The damage to the sample by the electron beam is cumulative. To avoid accumulating damage to the sample, we propose an early detection method that uses machine learning to detect changes in the object at an early stage while it is observed at low magnification. When more detailed information is necessary, the magnification can be increased and the observation of the object can be continued.</p>
<p>Recently, the use of machine learning in TEM has been integrated into the automation of tasks in biology (<xref ref-type="bibr" rid="B7">Falk et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B28">Wagner et&#x20;al., 2019</xref>). This research has been accelerated by image analysis without experts, resulting in a useful software package for acquiring and analyzing static images. As far as we know, no example of machine learning for <italic>in-situ</italic> observations has been reported. In this case, the waiting time for the results obtained by machine learning is important, as is the accuracy. One of the useful <italic>in situ</italic> observation methods is early object detection. Some methods of object detection in machine learning have been proposed including region-based convolution neural networks (R-CNN) (<xref ref-type="bibr" rid="B8">Girshick et&#x20;al., 2014</xref>), the single-shot multibox detector (SSD) algorithm (<xref ref-type="bibr" rid="B15">Liu et&#x20;al., 2016</xref>), the &#x201c;you only look once&#x201d; (YOLO) algorithm (<xref ref-type="bibr" rid="B19">Redmon et&#x20;al., 2016</xref>), and the EfficientDet model (<xref ref-type="bibr" rid="B24">Tan et&#x20;al., 2020</xref>). Although these detection methods differ from each other, they all detect objects in a rectangular region and classify the region. Semantic segmentation enabling pixel-wise detection methods such as fully convolutional networks (FCNs) (<xref ref-type="bibr" rid="B21">Long et&#x20;al., 2017</xref>), the Mask R-CNN (<xref ref-type="bibr" rid="B9">He et&#x20;al., 2017</xref>) can also detect objects. These methods might be useful if the time for the analysis is sufficiently long. Our interest in the present paper is object detection at a frame rate greater than 10 frames per second during <italic>in situ</italic> observation. From the viewpoint of early detection of events, it is sufficient to specify the region; thus, we carry out detection using a YOLO algorithm. The YOLOv5 algorithm (<xref ref-type="bibr" rid="B11">Jocher et&#x20;al., 2021</xref>) has recently been released and has been successfully used in the detection of tomato diseases (<xref ref-type="bibr" rid="B29">Wang et&#x20;al., 2021</xref>), the detection of signal lights for railways (<xref ref-type="bibr" rid="B16">Liu et&#x20;al., 2021</xref>), and the detection of smoking drivers (<xref ref-type="bibr" rid="B22">Shi et&#x20;al., 2021</xref>). All of these applications prioritize the detection speed over a reduction of the detection rate and are intended for real-time detection. In the aforementioned applications, color information also plays an important role. TEM images are grayscale, and the information contained in the image is relatively small. It is necessary to detect only differences in contrast.</p>
<p>In the present study, with <italic>in-situ</italic> observation in mind, we develop an early detection system based on machine learning for nucleation observed by LC-TEM. The achieved detectability is equivalent to the detection determined by determined by a human operator a video of recorded TEM images numerous times. It is suggested that the detection by machine learning earlier than the human&#x2019;s detection in <italic>in-situ</italic> observation where human see the image at the first time. Our system was used to calculate the growth rate and the nucleation rate. The detailed data related to the size of detected particles reveals that two phases of nanoparticles are present. In addition, we show the results of experiments in which a large number of nucleation events occurring can be analyzed in an instant to calculate the nucleation&#x20;rate.</p>
</sec>
<sec id="s2">
<title>2 Methods</title>
<p>To develop an early detection system by a CNN model, we prepared some videos acquired by LC-TEM. Our transmission electron microscope is equipped with a field-emission gun (JEM-2100F, JEOL, Tokyo) operated at an acceleration voltage of 200&#xa0;kV and a CMOS camera (Flash, EM-Z15327TCMOS; JEOL, Tokyo). The sample video captured the radiolysis-induced nucleation of sodium chloride (NaCl) from a saturated acetone solution of sodium chlorate (NaClO<sub>3</sub>) (<xref ref-type="bibr" rid="B30">Yamazaki and Kimura, 2021</xref>). As Cl<sup>&#x2212;</sup> ions were produced from Cl<inline-formula id="inf1">
<mml:math id="m1">
<mml:msubsup>
<mml:mrow>
<mml:mi mathvariant="normal">O</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>3</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mo>&#x2212;</mml:mo>
</mml:mrow>
</mml:msubsup>
</mml:math>
</inline-formula> ions by radiolysis, the abundant Na<sup>&#x2b;</sup> ions and the produced Cl<sup>&#x2212;</sup> ions formed a supersaturate state for NaCl crystals.</p>
<p>In ordinary nucleation, by lowering the temperature, the solubility is decreased. As a result, there is a difference between the dissolved amount and the solubility, and the supersaturation to solid becomes larger. In our case, the solubility remains unchanged, but the dissolved amount increase: Cl<sup>&#x2212;</sup> ions are produced by radiolysis of Cl<inline-formula id="inf2">
<mml:math id="m2">
<mml:msubsup>
<mml:mrow>
<mml:mi mathvariant="normal">O</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>3</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mo>&#x2212;</mml:mo>
</mml:mrow>
</mml:msubsup>
</mml:math>
</inline-formula> ions in the solution as suggested in <xref ref-type="bibr" rid="B30">Yamazaki and Kimura (2021)</xref>. Since the amount of Cl<sup>&#x2212;</sup> ions increases, the supersaturation of NaCl crystals to acetone solution increases.</p>
<p>When the observation was started, the electron beam was introduced into the solution, and the solution quickly becomes supersaturated. We used two sample solutions: one with and one without molecular sieves to remove residual water from the solution. Therefore, a very small amount of water (less than 0.3&#xa0;wt%) was present in the sample solution without molecular sieves because the acetone solution was a special reagent grade (FUJIFILM Wako Pure Chemical Corp., Osaka). Those sample solutions were prepared in a beaker. The solution was injected into the liquid cell of the TEM holder using a syringe. The typical magnification was 2000&#xd7; or 3,000&#xd7;, and the dose rate was approximately (2.0&#x2013;3.1)&#xd7; 10<sup>2</sup> electrons nm<sup>&#x2212;2</sup>s<sup>&#x2212;1</sup>. The frame rate of the videos was 10 fps. When we started the observation, nanoparticles of NaCl emerged immediately because of the irradiation. The shape of the NaCl particles depended on the degree of supersaturation (i.e.,&#x20;the experimental setup) although the crystal structure was NaCl type cubic and the crystal shape is a cube in equilibrium. In our video, two types of particles appear. The typical shape in one case is circular. The other particles are dendritic with three- or four- fold rotational symmetry because of the crystal orientation.</p>
<p>To prepare the training dataset, the images were extracted from the videos and annotated using LabelImg, which is an open-source program of an annotation application. To avoid false detection, we did not annotate the particles formed around the edges. We applied the standard YOLOv5 algorithm as the machine learning model to detect NaCl particles in a liquid. The images were input to the machine learning model and the output data was the positions and size of the boxes. The parameters of the model were adjusted so that the output data was fitted the annotated data. For training and validation, we used three videos that included particles with various shapes. These three videos differ from those analyzed in <xref ref-type="sec" rid="s3">Section&#x20;3</xref>.</p>
<p>The numbers of training and validation images was 322 and 34, respectively. Because each image shows several particles, the number of labels was 1859 for training and 188 for validation. After training using the model pretrained on the COCO dataset, we obtained the model parameter for YOLOv5s, which is the simplest model in YOLOv5. The model parameters were evaluated by two simple factors. One factor is the precision score, which is the fraction of correct detections among all detections shown in <xref ref-type="table" rid="T1">Table&#x20;1</xref>:<disp-formula id="e1">
<mml:math id="m3">
<mml:mi mathvariant="normal">P</mml:mi>
<mml:mi mathvariant="normal">r</mml:mi>
<mml:mi mathvariant="normal">e</mml:mi>
<mml:mi mathvariant="normal">c</mml:mi>
<mml:mi mathvariant="normal">i</mml:mi>
<mml:mi mathvariant="normal">s</mml:mi>
<mml:mi mathvariant="normal">i</mml:mi>
<mml:mi mathvariant="normal">o</mml:mi>
<mml:mi mathvariant="normal">n</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mi mathvariant="normal">T</mml:mi>
<mml:mi mathvariant="normal">P</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="normal">T</mml:mi>
<mml:mi mathvariant="normal">P</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mi mathvariant="normal">F</mml:mi>
<mml:mi mathvariant="normal">P</mml:mi>
</mml:mrow>
</mml:mfrac>
<mml:mo>.</mml:mo>
</mml:math>
<label>(1)</label>
</disp-formula>
</p>
<table-wrap id="T1" position="float">
<label>TABLE 1</label>
<caption>
<p>Precision scores [TP/(TP&#x002B;FP)] in the confusion matrix.</p>
</caption>
<table>
<thead>
<tr>
<td rowspan="2" colspan="2" align="left"/>
<td colspan="2" align="center">Detection</td>
</tr>
<tr>
<td align="center">Positive</td>
<td align="center">Negative</td>
</tr>
</thead>
<tbody valign="top">
<tr>
<td rowspan="2" align="left">Labels</td>
<td align="left">Positive</td>
<td align="left">
<bold>
<italic>True positive (TP) correct detection</italic>
</bold>
</td>
<td align="left">False negative (FN) missing labels</td>
</tr>
<tr>
<td align="left">Negative</td>
<td align="left">
<italic>False positive (FP) incorrect detection</italic>
</td>
<td align="left">True negative (TN)</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The other factor is the recall score, which is the fraction of correct detections among all labels shown in <xref ref-type="table" rid="T2">Table&#x20;2</xref>:<disp-formula id="e2">
<mml:math id="m4">
<mml:mi mathvariant="normal">R</mml:mi>
<mml:mi mathvariant="normal">e</mml:mi>
<mml:mi mathvariant="normal">c</mml:mi>
<mml:mi mathvariant="normal">a</mml:mi>
<mml:mi mathvariant="normal">l</mml:mi>
<mml:mi mathvariant="normal">l</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mi mathvariant="normal">T</mml:mi>
<mml:mi mathvariant="normal">P</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="normal">T</mml:mi>
<mml:mi mathvariant="normal">P</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mi mathvariant="normal">F</mml:mi>
<mml:mi mathvariant="normal">N</mml:mi>
</mml:mrow>
</mml:mfrac>
<mml:mo>.</mml:mo>
</mml:math>
<label>(2)</label>
</disp-formula>
</p>
<table-wrap id="T2" position="float">
<label>TABLE 2</label>
<caption>
<p>Recall scores [TP/(TP&#x002B;FN)] in the confusion matrix.</p>
</caption>
<table>
<thead>
<tr>
<td rowspan="2" align="left"/>
<td colspan="2" align="center">Detection</td>
</tr>
<tr>
<td align="center">Positive</td>
<td align="center">Negative</td>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Positive</td>
<td align="left">
<bold>
<italic>True positive (TP) correct detection</italic>
</bold>
</td>
<td align="left">False negative (FN) missing labels</td>
</tr>
<tr>
<td align="left">Negative</td>
<td align="left">
<italic>False positive (FP) incorrect detection</italic>
</td>
<td align="left">True negative (TN)</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The precision and recall scores of validation are 0.96 and 0.92, respectively, as summarized in <xref ref-type="table" rid="T3">Table&#x20;3</xref>.</p>
<table-wrap id="T3" position="float">
<label>TABLE 3</label>
<caption>
<p>The number of images and labels, and detection quality for validation.</p>
</caption>
<table>
<thead>
<tr>
<th colspan="2" align="center">Training</th>
<th colspan="4" align="center">Validation</th>
</tr>
<tr>
<th align="left">No. of images</th>
<th align="center">No. of labels</th>
<th align="center">No. of images</th>
<th align="center">No. of labels</th>
<th align="center">Precision</th>
<th align="center">Recall</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">322</td>
<td align="center">1,859</td>
<td align="center">34</td>
<td align="center">188</td>
<td align="center">0.96</td>
<td align="center">0.92</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec sec-type="results|discussion" id="s3">
<title>3 Results and Discussion</title>
<sec id="s3-1">
<title>3.1 Detection for Simple Objects</title>
<p>We detected NaCl particles yielded from an acetone solution of dissolved NaClO<sub>3</sub> powder crystals. The solution contained molecular sieves as a desiccant to eliminate residual water, which substantially lowered the amount of dissolved NaClO<sub>3</sub> because of the large difference in solubility [36&#xa0;g in 100&#xa0;g water vs. 4.2&#x20;&#xd7; 10<sup>&#x2013;5</sup>&#xa0;g in 100&#xa0;g acetone (<xref ref-type="bibr" rid="B2">Burgess, 1978</xref>)], thereby increasing the waiting time for nucleation of NaCl crystals. The magnification was 2000&#xd7;, and the dose rate was 310 electrons nm<sup>&#x2212;2</sup>s<sup>&#x2212;1</sup>. Examples of the detection of NaCl particles are shown in <xref ref-type="fig" rid="F1">Figure&#x20;1</xref>, where the image size is 12&#xa0;<italic>&#x3bc;</italic>m &#xd7; 12&#xa0;<italic>&#x3bc;</italic>m. We conducted a continuous observation, and the view was fixed at time <italic>t</italic>&#x20;&#x3d; 0&#xa0;s. In the dark area at the edge of the image, the electron beam was blocked by the aperture. The bright circular region was filled with the saturated acetone solution of NaClO<sub>3</sub>. Until 19&#xa0;s, no apparent change was observed and there was no detection (<xref ref-type="fig" rid="F1">Figure&#x20;1A</xref>). The first particle was detected at <italic>t</italic>&#x20;&#x3d; 19.1&#xa0;s (<xref ref-type="fig" rid="F1">Figure&#x20;1B</xref>) and exhibited a radius of &#x223c;150&#xa0;nm. The second, third, and fourth particles were detected at <italic>t</italic>&#x20;&#x3d; 22.4&#xa0;s (<xref ref-type="fig" rid="F1">Figure&#x20;1C</xref>), <italic>t</italic>&#x20;&#x3d; 24.5&#xa0;s (<xref ref-type="fig" rid="F1">Figure&#x20;1D</xref>), and <italic>t</italic>&#x20;&#x3d; 28.4&#xa0;s (<xref ref-type="fig" rid="F1">Figure&#x20;1E</xref>), respectively. In all cases, the radius of the particles was &#x223c;200&#xa0;nm at the beginning of the detection in the 12&#xa0;<italic>&#x3bc;</italic>m &#xd7; 12&#xa0;<italic>&#x3bc;</italic>m&#x20;image.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption>
<p>Examples of the detection of NaCl particles in a desiccant solution at <bold>(A)</bold> <italic>t</italic>&#x20;&#x3d; 5&#xa0;s, <bold>(B)</bold> <italic>t</italic>&#x20;&#x3d; 19.1&#xa0;s, <bold>(C)</bold> <italic>t</italic>&#x20;&#x3d; 22.2&#xa0;s, <bold>(D)</bold> <italic>t</italic>&#x20;&#x3d; 24.5&#xa0;s, <bold>(E)</bold> <italic>t</italic>&#x20;&#x3d; 28.4&#xa0;s, and <bold>(F)</bold> <italic>t</italic>&#x20;&#x3d; 45.6&#xa0;s.</p>
</caption>
<graphic xlink:href="fchem-10-818230-g001.tif"/>
</fig>
<p>
<xref ref-type="fig" rid="F2">Figure&#x20;2</xref> shows the change in the number of detected particles as a function of time. The red solid line and the green broken line show the number of detections and that of labeling by the human eye. Because the human-eye observations involve repeated observations and adjustments to the contrast, tiny particles can be labeled. The machine learning algorithm used in present study can detect particles with a delay of &#x223c;3&#xa0;s compared with the data labeling by the human eye. The delay in detection by the standard YOLOv5 algorithm is comparable to the delay when a person observes a particle when watching a video directly the first&#x20;time.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption>
<p>Time change of the number of particles corresponding to <xref ref-type="fig" rid="F1">Figure&#x20;1</xref> detected by machine learning (red solid line) and by the human eye (green broken line). The origin of time corresponds to when the view was&#x20;fixed.</p>
</caption>
<graphic xlink:href="fchem-10-818230-g002.tif"/>
</fig>
<p>In the video, the view is almost motionless until <italic>t</italic>&#x20;&#x3d; 45&#xa0;s. At <italic>t</italic>&#x20;&#x3e; 45&#xa0;s, the view shifts to the upper left. Thus, the particles appear to have moved to the lower right, as shown in <xref ref-type="fig" rid="F1">Figure&#x20;1F</xref>. The number of particles in the image also decreases. Even though part of the particle is hidden by the aperture and its shape appears to not be circular, it is still detected. Immediately before <italic>t</italic>&#x20;&#x3d; 50&#xa0;s, one half-moon-shaped particle is detected momentarily in the&#x20;video.</p>
<p>Although some detection failures occurred, no false positive were detected. In this video, the total recall score was 0.82 (<xref ref-type="table" rid="T4">Table&#x20;4</xref>). When particles became large (40&#xa0;s <inline-formula id="inf3">
<mml:math id="m5">
<mml:mo>&#x3c;</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>&#x3c;</mml:mo>
<mml:mn>50</mml:mn>
</mml:math>
</inline-formula> s), the recall score was 0.93. This recall value is approximately the same as that of the validation data shown in <xref ref-type="table" rid="T3">Table&#x20;3</xref>.</p>
<table-wrap id="T4" position="float">
<label>TABLE 4</label>
<caption>
<p>Numbers of images and labels and the detection quality.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left">No. of images</th>
<th align="center">No. of labels</th>
<th align="center">No. of detections</th>
<th align="center">Precision</th>
<th align="center">Recall</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">288</td>
<td align="center">1,282</td>
<td align="center">1,053</td>
<td align="center">1</td>
<td align="center">0.82</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>From the obtained data of corresponding to the detected boxes, we obtained time changes of the radii of five particles (<xref ref-type="fig" rid="F3">Figure&#x20;3</xref>). Each box is slightly larger than their corresponding particles. The systematic deviation does not strongly affect the study of its time change. The shape of particles is assumed to circular, and the radius of particles is estimated on the basis of the geometric average of one-half the height and one-half the width of the box. The growth rates of each particle were obtained by fitting the data in the region 35&#xa0;s <inline-formula id="inf4">
<mml:math id="m6">
<mml:mo>&#x3c;</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>&#x3c;</mml:mo>
</mml:math>
</inline-formula> 45&#xa0;s (solid lines in <xref ref-type="fig" rid="F3">Figure&#x20;3</xref>); these values are summarized in <xref ref-type="table" rid="T5">Table&#x20;5</xref>. The radius of the fifth particle may not be accurate because the window prevented us from observing the entire particle. The average growth rate excluding the fifth particle was 9.5&#xa0;nm s<sup>&#x2212;1</sup>.</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption>
<p>Five NaCl particles and change in radius with time, which corresponds to <xref ref-type="fig" rid="F1">Figure&#x20;1</xref>. Solid lines are obtained by fitting in the range 35&#xa0;s <inline-formula id="inf5">
<mml:math id="m7">
<mml:mo>&#x3c;</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>&#x3c;</mml:mo>
</mml:math>
</inline-formula>45&#xa0;s for each particle. Broken lines are obtained by fitting radii less than 400&#xa0;nm for particles 1 and 4. The inset shows a TEM image acquired after all five particles had formed (<italic>t</italic>&#x20;&#x3d; 35&#xa0;s). Numbers represents the order of appearance.</p>
</caption>
<graphic xlink:href="fchem-10-818230-g003.tif"/>
</fig>
<table-wrap id="T5" position="float">
<label>TABLE 5</label>
<caption>
<p>Growth rate of each nanoparticle.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left">Particle</th>
<th align="center">Growth rate (nm s<sup>&#x2212;1</sup>)</th>
<th align="center">Growth rate in small size (nm s<sup>&#x2212;1</sup>)</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">1</td>
<td align="char" char=".">9.1</td>
<td align="char" char=".">24.7</td>
</tr>
<tr>
<td align="left">2</td>
<td align="char" char=".">10.1</td>
<td align="center">&#x2014;</td>
</tr>
<tr>
<td align="left">3</td>
<td align="char" char=".">12.1</td>
<td align="center">&#x2014;</td>
</tr>
<tr>
<td align="left">4</td>
<td align="char" char=".">7.0</td>
<td align="char" char=".">21.6</td>
</tr>
<tr>
<td align="left">5</td>
<td align="char" char=".">5.3</td>
<td align="center">&#x2014;</td>
</tr>
<tr>
<td align="left">Average (1&#x2013;4)</td>
<td align="char" char=".">9.5</td>
<td align="center">&#x2014;</td>
</tr>
<tr>
<td align="left">Average (1, 4)</td>
<td align="center">&#x2014;</td>
<td align="char" char=".">23.1</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The growth rate <italic>V</italic>(<italic>r</italic>) can be predicted by classical nucleation theory. When a circular particle with radius <italic>r</italic> grows in a system, the growth rate <italic>V</italic>(<italic>r</italic>) is obtained as<disp-formula id="e3">
<mml:math id="m8">
<mml:mi>V</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>r</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>V</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>&#x221e;</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>&#x2212;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>r</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mtext>c</mml:mtext>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:mi>r</mml:mi>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:mfenced>
<mml:mo>,</mml:mo>
</mml:math>
<label>(3)</label>
</disp-formula>where <italic>r</italic>
<sub>c</sub> is the critical radius and <italic>V</italic>
<sub>
<italic>&#x221e;</italic>
</sub> is a constant, that depends on the concentration and the temperature. When the radius of the particle is larger than the critical radius, the growth rate is close to a constant asymptotically. The radius increases linearly with time. From our data, the value of the growth rate <italic>V</italic>
<sub>
<italic>&#x221e;</italic>
</sub> is &#x223c;9.5&#xa0;nm s<sup>&#x2212;1</sup>.</p>
<p>The growth rate <italic>V</italic> of the stem of the NaCl crystals under the dose rate <italic>F</italic> is written as <italic>V</italic>&#x20;&#x3d; <italic>K</italic>&#x2032;<italic>F</italic>
<sup>1/2</sup>, where the effective kinetic coefficient <italic>K</italic>&#x2032; is &#x223c;8.5 electron<sup>&#x2212;1/2</sup> nm<sup>2</sup>&#xa0;s<sup>1/2</sup> (Figure&#x20;6 in <xref ref-type="bibr" rid="B30">Yamazaki and Kimura (2021)</xref>]. When the dose rate is substituted as 310 electrons nm<sup>&#x2212;2 s&#x2212;1</sup>, the growth rate is obtained as 150&#xa0;nm s<sup>&#x2212;1</sup>, which is very different from our observed growth rate of 9.5&#xa0;nm s<sup>&#x2212;1</sup>. The effective dose rate appears to be reduced by the presence of molecular sieves in the solution. Because the crystal shown in Figure&#x20;6 in <xref ref-type="bibr" rid="B30">Yamazaki and Kimura (2021)</xref> is sufficiently large, the effective dose rate in <xref ref-type="fig" rid="F1">Figure&#x20;1</xref> is estimated as 1.2 electrons nm<sup>&#x2212;2</sup>s<sup>&#x2212;1</sup>, using a obtained growth rate of 9.5&#xa0;nm s<sup>&#x2212;1</sup>. Thus, the effective electron dose rate becomes 1/250 as a result of molecular sieves.</p>
<p>In classical nucleation theory, small particles grow slower than large particles because of the surface tension, which is well known as the Gibbs-Thomson effect. However, our data for particles 1 and 4 suggest the opposite trends: the growth rate of a small particle is larger than that of a large particle. The growth rates of particles 1 and 4 with radii less than 400&#xa0;nm are 24.7&#xa0;nm s<sup>&#x2212;1</sup> and 21.6&#xa0;nm s<sup>&#x2212;1</sup>, respectively. The magnitude of the growth rate of particles with a radius smaller than 400&#xa0;nm is twice larger than that of the same particle with a radius larger than 400&#xa0;nm. The particles do not rotate because they are formed on a membrane. In addition, our observed particle is approximately circular, and the orientational dependence of the growth rate is negligible. The growth rate is almost the same for particles 1 and 4, even though the timing of their formation is different. The degree of supersaturation does not change through the volume diffusion of materials.</p>
<p>There are two possibilities of the change of the growth rate. One is the occurrence of the phase transition of a particle at the radius of 400&#xa0;nm. Another is the heterogeneous nucleation of the stable phase on the metastable phase. Our observations do not allow us to distinguish between them. We speculate that the non-linear function arises from the crossover between the growth of the metastable phase and the growth by the heterogeneous nucleation of the stable phase on the surface of the metastable phase. Thus, the larger growth rate indicates that a metastable phase appears in the early stages of the nucleation process. This conclusion suggests that the nucleation of NaCl from a saturated solution of NaClO<sub>3</sub> in acetone is not a single-phase process. We therefore found an example of the two-step nucleation process of simple circular precipitates.</p>
</sec>
<sec id="s3-2">
<title>3.2 Detection for Objects With Complex Shape</title>
<p>We investigate the detectability of dendritic crystals that exhibit rapid growth. The magnification was 3,000&#xd7; and the dose rate was 2.0 &#xd7; 10<sup>2</sup> electron nm<sup>&#x2212;2</sup>s<sup>&#x2212;1</sup>. The solution was the same as that studied in the previous section but without the addition of molecular sieves. The outline of the video is as follows: The observation starts at <italic>t</italic>&#x20;&#x3d; 0&#xa0;s and many nanoparticles emerge within 1&#xa0;s. At <italic>t</italic>&#x20;&#x3d; 1&#xa0;s, the nucleation of nanoparticles is almost completed and each nanoparticle grows. Moreover, nanoparticles also coalesce with their neighbors. The production of nanoparticles stops because the solute is consumed by the nucleation and growth of the nanoparticles.</p>
<p>Examples of the detection by machine learning of dendritic crystals are shown in <xref ref-type="fig" rid="F4">Figure&#x20;4</xref>. Here, <italic>t</italic>&#x20;&#x3d; 0&#xa0;s corresponds to when the shutter was opened. Immediately after the shutter was opened (<xref ref-type="fig" rid="F4">Figure&#x20;4A</xref>), no objects were observed. At <italic>t</italic>&#x20;&#x3d; 0.4&#xa0;s, numerous tiny particles emerge although there is no detection by machine learning (<xref ref-type="fig" rid="F4">Figure&#x20;4B</xref>). Our detection by machine learning often overlooks small nuclei. The first detection is at <italic>t</italic>&#x20;&#x3d; 0.6&#xa0;s (<xref ref-type="fig" rid="F4">Figure&#x20;4C</xref>). As time passes, the number of detections increases (<xref ref-type="fig" rid="F4">Figures 4D&#x2013;F</xref>). To check the detectability, we counted the number of dendritic crystals by adjusting the contrast. <xref ref-type="fig" rid="F5">Figure&#x20;5</xref> shows the numbers of particles suggested by YOLOv5 (red square) and counted by the human eye (green cross). The numbers increase in the period <italic>t</italic>&#x20;&#x3c; 1&#xa0;s, and a difference is observed between the result obtained by YOLOv5 and that by the human eye. Both results show that the number of particles was steady at <italic>t</italic>&#x20;&#x3e; 3&#xa0;s, and both results are consistent. In the steady region (<italic>t</italic>&#x20;&#x3e; 3&#xa0;s), the dendritic crystals become large and are clearly observed and the change in the image is relatively small. In this case, the number of dendritic crystals counted by YOLOv5 is consistent with that of counted by the human eye. During steady growth, the standard YOLOv5 algorithm can detect crystals at the same level as the human eye, as mentioned in the preceding subsection.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption>
<p>Detection of NaCl particles with dendritic shape by machine learning at <bold>(A)</bold> 0.1&#xa0;s, <bold>(B)</bold> 0.4&#xa0;s, <bold>(C)</bold> 0.6&#xa0;s, <bold>(D)</bold> 1.5&#xa0;s, <bold>(E)</bold> 2.5&#xa0;s, and <bold>(F)</bold> 5.5&#xa0;s. The time of 0&#x20;s corresponds to the start of electron irradiation.</p>
</caption>
<graphic xlink:href="fchem-10-818230-g004.tif"/>
</fig>
<fig id="F5" position="float">
<label>FIGURE 5</label>
<caption>
<p>Time change in the number of particles counted by detection (red squares) and by the human eye (green cross) in <xref ref-type="fig" rid="F4">Figure&#x20;4</xref>. The time of 0&#xa0;s corresponds to the start of observation.</p>
</caption>
<graphic xlink:href="fchem-10-818230-g005.tif"/>
</fig>
<p>As we characterize the change of the number of particles over time, we can estimate the nucleation rate. The nucleation rate indicates how many nuclei are yielded per unit area and unit time. The observed nuclei appear on amorphous silicon nitride membranes on the top and the bottom of a silicon tip (<xref ref-type="bibr" rid="B30">Yamazaki and Kimura, 2021</xref>). The nucleation occurs in two dimensions and the area is &#x223c; 88&#xa0;<italic>&#x3bc;</italic>m<sup>2</sup>, when both the top and bottom surfaces of the membrane are considered. By fitting the data, we can estimate the nucleation rate as 0.3&#xa0;<italic>&#x3bc;</italic>m<sup>&#x2212;2</sup>s<sup>&#x2212;1</sup> (solid line) and 0.8&#xa0;<italic>&#x3bc;</italic>m<sup>&#x2212;2</sup>s<sup>&#x2212;1</sup> (broken line) on the basis of detection using the standard YOLOv5 algorithm and detection by the human eye, respectively. Although the number of particles by YOLOv5 is less than one-half of that detected by the human eye, the estimated nucleation rates are of the same order. In most discussions concerning crystallization, determining the order of the nucleation rate is sufficient. If we need to estimate physical quantities such as the nucleation rate more accurately, improving&#x20;the detectability by preprocessing the images is worthwhile.</p>
<p>In the preceding subsection, we detected circular shaped particles in a video in which the particles slowly changed. In this subsection, we detect dendritic particles whose size and shape change rapidly under a dose rate of 2.0 &#xd7; 10<sup>2</sup> electron nm<sup>&#x2212;2</sup>s<sup>&#x2212;1</sup>. As reported in (<xref ref-type="bibr" rid="B30">Yamazaki and Kimura, 2021</xref>), the growth rate depends on the dose rate in a solution without molecular sieves. Although the dose rate is smaller than that in <xref ref-type="fig" rid="F1">Figure&#x20;1</xref>, numerous dendrites are formed. The shape of the nanoparticles depends on the degree of supersaturation. When the degree of supersaturation is low, the shape is similar to the equilibrium shape, which is compact. When the degree of supersaturation is high, the shape becomes dendritic because fast growth proceeds before sufficient relaxation of the shape can occur. Because the amount of water is related to the precipitation of NaCl crystals, the effect of water loss due to molecular sieves strongly affects the degree of supersaturation. The decrease in the degree of supersaturation is attributed to a decrease in the amount of dissolved chlorate ions, which become chloride ions (<xref ref-type="bibr" rid="B30">Yamazaki and Kimura, 2021</xref>). In <xref ref-type="fig" rid="F2">Figure&#x20;2</xref>, we observe the appearance of five particles in the 126&#xa0;<italic>&#x3bc;</italic>m<sup>2</sup> solution area in 10&#xa0;s and the nucleation rate is estimated as 0.004&#xa0;<italic>&#x3bc;</italic>m<sup>&#x2212;2</sup> s<sup>&#x2212;1</sup>. This rate is 200&#x20;times smaller than the value obtained in <xref ref-type="fig" rid="F4">Figure&#x20;4</xref>. It is a conventional result because of the same aforementioned conclusion deduced from the crystal&#x20;shape.</p>
<p>When a large number of nuclei are produced in a small area, the growth rate becomes small because the growth of each nucleus competes with other nuclei on the supplied material. Although this effect should be studied in detail according to the rate-limiting process, the limiting process of the present system, including the radical reaction, is unclear. However, the influence of the surrounding nuclei is relatively weak immediately after the nucleation occurs. From the classical nucleation theory, the nucleation rate <italic>J</italic> is written as <italic>J</italic>&#x20;&#x3d; <italic>&#x3c9;</italic>&#x2a;&#x393;<italic>Z</italic>
<sub>1</sub>&#x2009; exp (&#x2212;&#x394;<italic>G</italic>&#x2a;/<italic>k</italic>
<sub>B</sub>
<italic>T</italic>) where <italic>&#x3c9;</italic> is the frequency of the attachment of atoms to the critical nucleus, &#x393; is the Zeldovich factor, <italic>Z</italic>
<sub>1</sub> is the steady-state concentration of a monomer, and &#x394;<italic>G</italic>&#x2a; is the free energy of the critical nucleus (<xref ref-type="bibr" rid="B17">Markov, 2003</xref>). The pre-exponential factor <italic>A</italic>&#x20;&#x3d; <italic>&#x3c9;</italic>&#x2a;&#x393;<italic>Z</italic>
<sub>1</sub> is not sensitive to the supersaturation in comparison with &#x2009; exp (&#x2212;&#x394;<italic>G</italic>&#x2a;/<italic>k</italic>
<sub>B</sub>
<italic>T</italic>) &#x3d; exp (&#x2212;<italic>B</italic>/&#x394;<italic>&#x3bc;</italic>
<sup>2</sup>). Therefore, we assume<disp-formula id="e4">
<mml:math id="m9">
<mml:mi>J</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mi>A</mml:mi>
<mml:mo>&#x2061;</mml:mo>
<mml:mi>exp</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mi>B</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="normal">&#x394;</mml:mi>
<mml:msup>
<mml:mrow>
<mml:mi>&#x3bc;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:mfenced>
<mml:mo>,</mml:mo>
</mml:math>
<label>(4)</label>
</disp-formula>where <italic>B</italic>&#x20;&#x3d; 16<italic>&#x3c0;&#x3c3;</italic>
<sup>3</sup>
<italic>v</italic>/(3<italic>k</italic>
<sub>B</sub>
<italic>T</italic>), <italic>&#x3c3;</italic> is the interfacial energy, <italic>k</italic>
<sub>B</sub> is the Boltzmann constant, and <italic>T</italic> is the temperature. The ratio of the nucleation rate in <xref ref-type="fig" rid="F1">Figure&#x20;1</xref> (<italic>J</italic>
<sub>1</sub>) to that in <xref ref-type="fig" rid="F4">Figure&#x20;4</xref> (<italic>J</italic>
<sub>4</sub>) is<disp-formula id="e5">
<mml:math id="m10">
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>J</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>J</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>4</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x3d;</mml:mo>
<mml:mi>exp</mml:mi>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>B</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="normal">&#x394;</mml:mi>
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3bc;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x2212;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>B</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>4</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="normal">&#x394;</mml:mi>
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3bc;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>4</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x2243;</mml:mo>
<mml:mi>exp</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>B</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="normal">&#x394;</mml:mi>
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3bc;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:mfenced>
<mml:mo>,</mml:mo>
</mml:math>
<label>(5)</label>
</disp-formula>where &#x394;<italic>&#x3bc;</italic>
<sub>1</sub> and &#x394;<italic>&#x3bc;</italic>
<sub>4</sub> are the chemical potential of the solid phase in <xref ref-type="fig" rid="F1">Figures 1</xref>, <xref ref-type="fig" rid="F4">4</xref>, respectively. Here, we ignore the term &#x394;<italic>&#x3bc;</italic>
<sub>4</sub> because the effective dose rate in <xref ref-type="fig" rid="F1">Figure&#x20;1</xref>, as discussed in the previous subsection is sufficiently smaller than that in <xref ref-type="fig" rid="F4">Figure&#x20;4</xref>. The lower limit of the ratio of the interfacial energy and the chemical potential is obtained as<disp-formula id="e6">
<mml:math id="m11">
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>B</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="normal">&#x394;</mml:mi>
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3bc;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x2243;</mml:mo>
<mml:mi>ln</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>J</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>4</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>J</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x2243;</mml:mo>
<mml:mn>5.3</mml:mn>
<mml:mo>,</mml:mo>
</mml:math>
<label>(6)</label>
</disp-formula>where <italic>B</italic>
<sub>1</sub> depends on the interfacial energy of an unknown phase discussed in the previous subsection and <italic>J</italic>
<sub>1</sub> is the effective dose rate (1.2 electrons nm<sup>&#x2212;2</sup> s<sup>&#x2212;1</sup>).</p>
<p>In Figure&#x20;2A of <xref ref-type="bibr" rid="B30">Yamazaki and Kimura (2021)</xref>, two NaCl crystals appears in an area of 22&#xa0;<italic>&#x3bc;</italic>m<sup>2</sup> in 10&#xa0;s with an electron dose rate <italic>J</italic>
<sub>2</sub> &#x3d; 37 electron nm<sup>&#x2212;2</sup> s<sup>&#x2212;1</sup>. The crystal shape is dendritic, and its symmetry is reflected in the crystal symmetry. The precipitate is assumed to be crystalline, and it is not identical to that in <xref ref-type="fig" rid="F1">Figure&#x20;1</xref> because the particles are circular. Using the same approach, we obtain the relation of the interfacial energy <italic>B</italic>
<sub>2</sub> and the chemical potential to the solid &#x394;<italic>&#x3bc;</italic>
<sub>2</sub> as<disp-formula id="e7">
<mml:math id="m12">
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>B</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="normal">&#x394;</mml:mi>
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3bc;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:msubsup>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x2243;</mml:mo>
<mml:mi>ln</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>J</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>4</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>J</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x2243;</mml:mo>
<mml:mn>4.5</mml:mn>
<mml:mo>.</mml:mo>
</mml:math>
<label>(7)</label>
</disp-formula>
</p>
<p>
<italic>B</italic>
<sub>2</sub> depends on the interfacial energy of the solid phase of the NaCl crystal. Because the chemical potential &#x394;<italic>&#x3bc;</italic> depends on the 1/2 power of the dose rate, we can estimate the difference of the interfacial energy of the unknown phase <italic>&#x3c3;</italic>
<sub>1</sub> and crystal phase <italic>&#x3c3;</italic>
<sub>2</sub> as <italic>&#x3c3;</italic>
<sub>1</sub> &#x2243; 0.33<italic>&#x3c3;</italic>
<sub>2</sub>. In general, the interfacial energy of a metastable phase is smaller than that of a stable phase; therefore, metastable crystals nucleate before stable crystals. The present system also conforms to this empirical&#x20;rule.</p>
<p>We attempted to identify the unknown metastable phase of NaCl shown in <xref ref-type="fig" rid="F1">Figure&#x20;1</xref>. The possible structures for the NaCl crystals are the NaCl-type structure and CsCl-type structure, and the NaCl-type is observed in the stable phase. The ratio of the interfacial energy of the CsCl-type to that of the NaCl-type can be roughly estimated by a bond counting method. On the (100) surface of the NaCl-type structure, the number of Na<sup>&#x2b;</sup> ions and Cl<sup>&#x2212;</sup> ions is 2 and 2, respectively, in a unit cell with a lattice constant 5.6&#xa0;&#xc5;. On the (100) surface of the CsCl-type, the number of Na<sup>&#x2b;</sup> ions and Cl<sup>&#x2212;</sup> ions are 0.5 and 0.5, respectively, in one unit cell. Its lattice constant is assumed to be 3.3&#xa0;&#xc5; on the basis of the ratio of the lattice constant of NaCl-type to CsCl-type of other crystals such as CsCl crystals and CsBr crystals (<xref ref-type="bibr" rid="B13">Kimura et&#x20;al., 2002</xref>). The ratio of the interfacial energy of CsCl-type to NaCl-type is &#x223c;0.71. Because the ratio of the interfacial energy of the unknown phase shown in <xref ref-type="fig" rid="F1">Figure&#x20;1</xref> to that of the NaCl crystal shown in <xref ref-type="fig" rid="F4">Figure&#x20;4</xref> is 0.33, the interfacial energy of the unknown phase is inconsistent with that of a CsCl-type NaCl crystal. In conclusion, we inferred that the unknown phase observed in <xref ref-type="fig" rid="F1">Figure&#x20;1</xref> is an amorphous phase of NaCl or dense-liquid after liquid-liquid phase separation because of the large growth rate, the circular shape, and the small interfacial energy.</p>
<p>Object detection algorithm have difficulty in detecting small objects, and first detection is inevitably delayed. Here, the difference is only 0.2&#xa0;s, which is shorter than the detection delay in the previous section, where particles nucleated slowly. However, object detection is adequate for early detection because some recent TEM cameras can record several seconds before using the lookback function. By integrating the detection system into a transmission electron microscope, rare events such as nucleation phenomena will be captured within the limited resources for recording. The time necessary for the detection is within 10&#xa0;ms without the CPU-GPU data transfer. Because the time required for real-time detection, which depends on the PC configuration, is approximately 15&#x2013;35&#xa0;ms including the CPU-GPU data transfer (<xref ref-type="bibr" rid="B12">Katsuno et&#x20;al., 2021</xref>), object detection of nucleation phenomenon in <italic>in situ</italic> observation is possible when the image data are received directly through the software of a TEM camera.</p>
</sec>
</sec>
<sec id="s4">
<title>4 Summary</title>
<p>We proposed a method for the early detection of nucleation phenomena using TEM observations in conjunction with the machine learning. For the detection method to be used in <italic>in situ</italic> observations, the standard YOLOv5 algorithm was adopted.</p>
<p>The detection method was applied to the nucleation of NaCl crystals from a solution of acetone and NaClO<sub>3</sub>. Although the detection of emerging particles sometimes failed, the particles with isolated circular shapes were detected even if particles&#x20;moved.</p>
<p>We also obtained detailed information on local stochastic process such as the time change of the size of individual particles.</p>
<p>The growth rates of each particle were calculated from the detection data. The results suggested that nanoparticles with a radius smaller than 400&#xa0;nm and those with a radius larger than 400&#xa0;nm were different phases. Nanoparticles with a dendritic shape were also detected. Although the detection rate was slightly lower, the estimated nucleation rate was of the same order as that estimated using manual procedures, where the images are preprocessed and then nanoparticles are counted. The preprocessing of the images enables quantitative evaluation with disadvantages in terms of early detection. Using the classical nucleation theory, we investigated the effect of an additive (molecular sieves). The additive lowered the degree of supersaturation. From the classical nucleation theory, the interfacial energy of the unknown phase of NaCl was estimated to be one-third of the interfacial energy of a NaCl crystal. This value is smaller than the roughly estimated interfacial energy of a NaCl crystal with a CsCl-type structure. We inferred from the high growth rate, the circular shape, small interfacial energy that the observed unknown phase was an amorphous or dense-liquid phase of&#x20;NaCl.</p>
<p>The delay in the first detection of nanoparticles was &#x223c; 3&#xa0;s and &#x223c; 0.2&#xa0;s for particles with a large compact circular shape and particles with a small dendritic shape, respectively. The delay could be recovered by the TEM function of a recent camera, which enabled us to record several seconds before. Because the time for detection was within 20&#xa0;ms, nucleation phenomena could be observed during <italic>via in&#x20;situ</italic> observations when the detection system is integrated into the software of a TEM camera.</p>
<p>The problem of the time necessary for detection will be resolved with the development of computers. We hope that the opportunity to discover new science will be found by machine learning techniques just as our finding of the two-step nucleation process.</p>
</sec>
</body>
<back>
<sec id="s5">
<title>Data Availability Statement</title>
<p>The raw data supporting the conclusion of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="s6">
<title>Author Contributions</title>
<p>HK designed the computational framework with support from IT and analyzed the data. YK conceived the presented idea. TY and YK carried out TEM observations. HK wrote the manuscript. All authors contributed to the final manuscript.</p>
</sec>
<sec id="s7">
<title>Funding</title>
<p>This work is supported by JSPS KAKENHI Grant Numbers 20H05657 and 21K03379.</p>
</sec>
<sec sec-type="COI-statement" id="s8">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s9">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ack>
<p>Authors thank to Shizuka Hirakawa of Institute of Low Temperature Science, Hokkaido University, for supporting of making annotation data for the machine learning and supporting TEM experiments.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Anada</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Nomura</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Hirayama</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Yamamoto</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Sparse Coding and Dictionary Learning for Electron Hologram Denoising</article-title>. <source>Ultramicroscopy</source> <volume>206</volume>, <fpage>112818</fpage>. <pub-id pub-id-type="doi">10.1016/j.ultramic.2019.112818</pub-id> </citation>
</ref>
<ref id="B2">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Burgess</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>1978</year>). <source>Metal Ions in Solution</source>. <publisher-loc>Chichester, United Kingdom</publisher-loc>: <publisher-name>Horwood</publisher-name>. </citation>
</ref>
<ref id="B3">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>de Jonge</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Houben</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Dunin-Borkowski</surname>
<given-names>R. E.</given-names>
</name>
<name>
<surname>Ross</surname>
<given-names>F. M.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Resolution and Aberration Correction in Liquid Cell Transmission Electron Microscopy</article-title>. <source>Nat. Rev. Mater.</source> <volume>4</volume>, <fpage>61</fpage>&#x2013;<lpage>78</lpage>. <pub-id pub-id-type="doi">10.1038/s41578-018-0071-2</pub-id> </citation>
</ref>
<ref id="B4">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>de Jonge</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Ross</surname>
<given-names>F. M.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>Electron Microscopy of Specimens in Liquid</article-title>. <source>Nat. Nanotech</source> <volume>6</volume>, <fpage>695</fpage>&#x2013;<lpage>704</lpage>. <pub-id pub-id-type="doi">10.1038/nnano.2011.161</pub-id> </citation>
</ref>
<ref id="B5">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>De Yoreo</surname>
<given-names>J.&#x20;J.</given-names>
</name>
<name>
<surname>Gilbert</surname>
<given-names>P. U. P. A.</given-names>
</name>
<name>
<surname>Sommerdijk</surname>
<given-names>N. A. J.&#x20;M.</given-names>
</name>
<name>
<surname>Penn</surname>
<given-names>R. L.</given-names>
</name>
<name>
<surname>Whitelam</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Joester</surname>
<given-names>D.</given-names>
</name>
<etal/>
</person-group> (<year>2015</year>). <article-title>Crystallization by Particle Attachment in Synthetic, Biogenic, and Geologic Environments</article-title>. <source>Science</source> <volume>349</volume>, <fpage>aaa6760</fpage>. <pub-id pub-id-type="doi">10.1126/science.aaa6760</pub-id> </citation>
</ref>
<ref id="B6">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Egerton</surname>
<given-names>R. F.</given-names>
</name>
<name>
<surname>Li</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Malac</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2004</year>). <article-title>Radiation Damage in the TEM and SEM</article-title>. <source>Micron</source> <volume>35</volume>, <fpage>399</fpage>&#x2013;<lpage>409</lpage>. <pub-id pub-id-type="doi">10.1016/j.micron.2004.02.003</pub-id> </citation>
</ref>
<ref id="B7">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Falk</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Mai</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Bensch</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>&#xc7;i&#xe7;ek</surname>
<given-names>&#xd6;.</given-names>
</name>
<name>
<surname>Abdulkadir</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Marrakchi</surname>
<given-names>Y.</given-names>
</name>
<etal/>
</person-group> (<year>2019</year>). <article-title>U-net: Deep Learning for Cell Counting, Detection, and Morphometry</article-title>. <source>Nat. Methods</source> <volume>16</volume>, <fpage>67</fpage>&#x2013;<lpage>70</lpage>. <pub-id pub-id-type="doi">10.1038/s41592-018-0261-2</pub-id> </citation>
</ref>
<ref id="B8">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Girshick</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Donahue</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Darrell</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Malik</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2014</year>). &#x201c;<article-title>Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation</article-title>,&#x201d; in <conf-name>2014 IEEE Conference on Computer Vision and Pattern Recognition</conf-name>. <pub-id pub-id-type="doi">10.1109/CVPR.2014.81</pub-id> </citation>
</ref>
<ref id="B9">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>He</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Gkioxari</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Dollar</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Girshick</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2017</year>). &#x201c;<article-title>Mask R-Cnn</article-title>,&#x201d; in <conf-name>Proceedings of the IEEE international Conference on Computer Vision (ICCV)</conf-name>, <fpage>2961</fpage>&#x2013;<lpage>2969</lpage>. <pub-id pub-id-type="doi">10.1109/iccv.2017.322</pub-id> </citation>
</ref>
<ref id="B10">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ishizuka</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Kimura</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Yokoi</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Yamazaki</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Sato</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Hama</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Self-assembly of MoO3 needles in Gas Current for Cubic Formation Pathway</article-title>. <source>Nanoscale</source> <volume>9</volume>, <fpage>10109</fpage>&#x2013;<lpage>10116</lpage>. <pub-id pub-id-type="doi">10.1039/C7NR02613G</pub-id> </citation>
</ref>
<ref id="B11">
<citation citation-type="journal">
<comment>[Dataset]</comment> <person-group person-group-type="author">
<name>
<surname>Jocher</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Stoken</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Borovec</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Chaurasia</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Changyu</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Abhiram</surname>
<given-names>V.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). <article-title>ultralytics/yolov5: v5.0 - YOLOv5-P6 1280 Models, AWS, Supervise.Ly and YouTube Integrations</article-title>. <pub-id pub-id-type="doi">10.5281/zenodo.4679653</pub-id> </citation>
</ref>
<ref id="B12">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Katsuno</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Kimura</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Yamazaki</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Takigawa</surname>
<given-names>I.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Fast Improvement of TEM Images with Low-Dose Electrons by Deep Learning</article-title>. <comment>arXiv</comment>. </citation>
</ref>
<ref id="B13">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kimura</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Saito</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Nakada</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Kaito</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2002</year>). <article-title>Spontaneous Mixing of Binary Alkali Halide crystal by Successive Evaporation</article-title>. <source>Physica E: Low-dimensional Syst. Nanostructures</source> <volume>13</volume>, <fpage>11</fpage>&#x2013;<lpage>23</lpage>. <pub-id pub-id-type="doi">10.1016/S1386-9477(01)00226-0</pub-id> </citation>
</ref>
<ref id="B14">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lee</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Wi</surname>
<given-names>H. S.</given-names>
</name>
<name>
<surname>Jo</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Cho</surname>
<given-names>Y. C.</given-names>
</name>
<name>
<surname>Lee</surname>
<given-names>H. H.</given-names>
</name>
<name>
<surname>Jeong</surname>
<given-names>S.-Y.</given-names>
</name>
<etal/>
</person-group> (<year>2016</year>). <article-title>Multiple Pathways of crystal Nucleation in an Extremely Supersaturated Aqueous Potassium Dihydrogen Phosphate (KDP) Solution Droplet</article-title>. <source>Proc. Natl. Acad. Sci. USA</source> <volume>113</volume>, <fpage>13618</fpage>&#x2013;<lpage>13623</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1604938113</pub-id> </citation>
</ref>
<ref id="B15">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Liu</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Anguelov</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Erhan</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Szegedy</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Reed</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Fu</surname>
<given-names>C.-Y.</given-names>
</name>
<etal/>
</person-group> (<year>2016</year>). &#x201c;<article-title>SSD: Single Shot Multibox Detector</article-title>,&#x201d; in <conf-name>European Conference on Computer Vision &#x2013; ECCV 2016</conf-name>, <fpage>21</fpage>&#x2013;<lpage>37</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-319-46448-0_2</pub-id> </citation>
</ref>
<ref id="B16">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Liu</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Zhou</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Yang</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Gong</surname>
<given-names>Z.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Real-time Signal Light Detection Based on Yolov5 for Railway</article-title>. <source>IOP Conf. Ser. Earth Environ. Sci.</source> <volume>769</volume>, <fpage>042069</fpage>. <pub-id pub-id-type="doi">10.1088/1755-1315/769/4/042069</pub-id> </citation>
</ref>
<ref id="B17">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Markov</surname>
<given-names>I. V.</given-names>
</name>
</person-group> (<year>2003</year>). <source>Crystal Growth for Beginners</source>. <edition>2nd ed</edition>. <publisher-loc>27 Warren Street, Suite 401&#x2013;402, Hackensack, NJ 07601</publisher-loc>: <publisher-name>World Scientific Publishing Co. Ltd</publisher-name>. </citation>
</ref>
<ref id="B18">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Michely</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Krug</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2004</year>). <source>Island, Mounds and Atoms &#x2014;Patterns and Processes in Crystal Growth Far from Equilibrium</source>. <publisher-loc>Berlin Heidelberg</publisher-loc>: <publisher-name>Springer-Verlag</publisher-name>. </citation>
</ref>
<ref id="B19">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Redmon</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Divvala</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Girshick</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Farhadi</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2016</year>). &#x201c;<article-title>You Only Look once: Unified, Real-Time Object Detection</article-title>,&#x201d; in <conf-name>2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)</conf-name>. <pub-id pub-id-type="doi">10.1109/CVPR.2016.91</pub-id> </citation>
</ref>
<ref id="B20">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Schneider</surname>
<given-names>N. M.</given-names>
</name>
<name>
<surname>Norton</surname>
<given-names>M. M.</given-names>
</name>
<name>
<surname>Mendel</surname>
<given-names>B. J.</given-names>
</name>
<name>
<surname>Grogan</surname>
<given-names>J.&#x20;M.</given-names>
</name>
<name>
<surname>Ross</surname>
<given-names>F. M.</given-names>
</name>
<name>
<surname>Bau</surname>
<given-names>H. H.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Electron-water Interactions and Implications for Liquid Cell Electron Microscopy</article-title>. <source>J.&#x20;Phys. Chem. C</source> <volume>118</volume>, <fpage>22373</fpage>&#x2013;<lpage>22382</lpage>. <pub-id pub-id-type="doi">10.1021/jp507400n</pub-id> </citation>
</ref>
<ref id="B21">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shelhamer</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Long</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Darrell</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Fully Convolutional Networks for Semantic Segmentation</article-title>. <source>IEEE Trans. Pattern Anal. Mach. Intell.</source> <volume>39</volume>, <fpage>640</fpage>&#x2013;<lpage>651</lpage>. <pub-id pub-id-type="doi">10.1109/TPAMI.2016.2572683</pub-id> </citation>
</ref>
<ref id="B22">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shi</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Zhou</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Ye</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Mai</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Faster Detection Method of Driver Smoking Based on Decomposed Yolov5</article-title>. <source>J.&#x20;Phys. Conf. Ser.</source> <volume>1993</volume>, <fpage>012035</fpage>. <pub-id pub-id-type="doi">10.1088/1742-6596/1993/1/012035</pub-id> </citation>
</ref>
<ref id="B23">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Takahashi</surname>
<given-names>K. Z.</given-names>
</name>
<name>
<surname>Aoyagi</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Fukuda</surname>
<given-names>J.-i.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Multistep Nucleation of Anisotropic Molecules</article-title>. <source>Nat. Commun.</source> <volume>12</volume>, <fpage>5278</fpage>. <pub-id pub-id-type="doi">10.1038/s41467-021-25919-310.1038/s41467-021-25586-4</pub-id> </citation>
</ref>
<ref id="B24">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Tan</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Pang</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Le</surname>
<given-names>Q. V.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Efficientdet: Scalable and Efficient Object Detection</article-title>. <comment>arXiv</comment>. <pub-id pub-id-type="doi">10.1109/cvpr42600.2020.01079</pub-id> </citation>
</ref>
<ref id="B25">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Tanaka</surname>
<given-names>K. K.</given-names>
</name>
<name>
<surname>Diemand</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Tanaka</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Ang&#xe9;lil</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Analyzing Multistep Homogeneous Nucleation in Vapor-To-Solid Transitions Using Molecular Dynamics Simulations</article-title>. <source>Phys. Rev. E</source> <volume>96</volume>, <fpage>022804</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.96.022804</pub-id> </citation>
</ref>
<ref id="B26">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Van Driessche</surname>
<given-names>A. E. S.</given-names>
</name>
<name>
<surname>Van Gerven</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Bomans</surname>
<given-names>P. H. H.</given-names>
</name>
<name>
<surname>Joosten</surname>
<given-names>R. R. M.</given-names>
</name>
<name>
<surname>Friedrich</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Gil-Carton</surname>
<given-names>D.</given-names>
</name>
<etal/>
</person-group> (<year>2018</year>). <article-title>Molecular Nucleation Mechanisms and Control Strategies for crystal Polymorph Selection</article-title>. <source>Nature</source> <volume>556</volume>, <fpage>89</fpage>&#x2013;<lpage>94</lpage>. <pub-id pub-id-type="doi">10.1038/nature25971</pub-id> </citation>
</ref>
<ref id="B27">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Vincent</surname>
<given-names>J.&#x20;L.</given-names>
</name>
<name>
<surname>Manzorro</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Mohan</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Tang</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Sheth</surname>
<given-names>D. Y.</given-names>
</name>
<name>
<surname>Simoncelli</surname>
<given-names>E. P.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). <article-title>Developing and Evaluating Deep Neural Network-Based Denoising for Nanoparticle TEM Images with Ultra-low Signal-To-Noise</article-title>. <comment>arXiv</comment>. <pub-id pub-id-type="doi">10.1017/s1431927621012678</pub-id> </citation>
</ref>
<ref id="B28">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wagner</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Merino</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Stabrin</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Moriya</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Antoni</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Apelbaum</surname>
<given-names>A.</given-names>
</name>
<etal/>
</person-group> (<year>2019</year>). <article-title>Sphire-cryolo Is a Fast and Accurate Fully Automated Particle Picker for Cryo-EM</article-title>. <source>Commun. Biol.</source> <volume>2</volume>, <fpage>218</fpage>. <pub-id pub-id-type="doi">10.1038/s42003-019-0437-z</pub-id> </citation>
</ref>
<ref id="B29">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Liu</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Zhu</surname>
<given-names>X.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Early Real-Time Detection Algorithm of Tomato Diseases and Pests in the Natural Environment</article-title>. <source>Plant Methods</source> <volume>17</volume>, <fpage>43</fpage>. <pub-id pub-id-type="doi">10.1186/s13007-021-00745-2</pub-id> </citation>
</ref>
<ref id="B30">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Yamazaki</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Kimura</surname>
<given-names>Y.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Radiolysis-induced Crystallization of Sodium Chloride in Acetone by Electron Beam Irradiation</article-title>. <source>Microsc. Microanal</source> <volume>27</volume>, <fpage>459</fpage>&#x2013;<lpage>465</lpage>. <pub-id pub-id-type="doi">10.1017/S1431927621000179</pub-id> </citation>
</ref>
</ref-list>
</back>
</article>