Lithuanian Journal of Physics, Vol. 62, No. 3, pp. 171–178 (2022)
© Lietuvos mokslų akademija, 2022
Received 6 June 2022; revised 31 July 2022; accepted 13 September 2022
The separation of ionizing radiation particles is an important and challenging task, especially regarding neutrons and gamma rays. The separation of neutron and gamma radiation is necessary for safeguard purposes and control of nuclear reactions. Standard mathematical models of pulse analysis work well in the presence of large energy transfer (>1 MeV) from the particle to the detector. However, the quality of the separation decreases as the amount of transferred energy lessens, making it impossible to determine the exact type of particle at a sufficiently low-energy level.
In this work, an artificial neural network model was used to solve the problem of separation at low-energy levels. The supervised machine learning (ML) model was used to analyse pulses received from the polyethylene naphthalate (PEN) scintillation detector. Several data sets after the PEN exposure to neutron/gamma (combined 239PuBe and 238PuBe source), alpha (238Pu) and beta (90Sr/90Y) sources were used to train the models. The information obtained from the separation of neutrons and gamma particles was compared with the information obtained using standard pulses delayed fluorescence analysis methods. The obtained results showed that the model was able to separate particles in the fields of low- and high-energy transfer.
Keywords: radiation particle discrimination, ANN, machine learning, scintillation detectors
Neutron detection is one of the most important tasks in neutron spectroscopy studies and in the design and construction of setup for neutron shielding. Scintillation detectors are most suitable in the field due to their ability to register the spectrum and determine the particle type independently of neutron energy, whereas gaseous 3He detectors are much more effective in the region of thermal neutron energy. Additionally, the 3He gas itself is expensive due to its low natural abundance and required production from radioactive tritium [1]. A negative feature of scintillation detectors is their sensitivity to gamma radiation, thus impulses induced by gamma photons are unavoidable when recording neutron flux, because of the nature of neutrons. As a result, the accuracy of the detectors decreases when neutrons are recorded. Pulse shape discrimination (PSD) methods are used to distinguish neutron-induced pulses [2–4]. PSD can be applied due to the delayed fluorescence most seen in organic scintillators, anthracene being one of the most popular organic crystals usable for this purpose [5]. Light is likely to be emitted via the triplet–triplet annihilation (TTA) energy relaxation mechanism when heavy ionizing radiation particles lose energy in organic scintillator detector material [6]. Singlet excitation state relaxation provides a prompt and major part of emitted scintillation light. Due to TTA, part of the light is emitted late, resulting in delayed fluorescence.
The common PSD methods are the ratio of delayed fluorescence intensity with the prompt fluorescence component comparison, the rise time and the zero-crossing methods. Comparison of a delayed fluorescence integral with a full pulse integral is used most often.
The scintillation light enters the photomultiplier, where it is converted to electrons because of the photoelectric effect. After the secondary emission of electrons in the phototube, the total charge is converted into an electrical pulse. The pulse is digitized via the ADC converter. The results are used in further analysis.
The separation quality of neutrons and gamma ionizing radiation is described by the figure of merit (FOM) parameter. The FOM parameter is defined as a distance between two different types of pulses in a specific energy range, divided by the sum of the full width at half maximum (FWHM) of the PSD ratio of pulses [7]. The higher the FOM parameter, the better the separation of the pulse inducted by neutrons and gamma radiation particles. When the FOM parameter becomes <1, the separation becomes inaccurate. In this case, only the probability that the particle is determined correctly can be assessed because the normal Gaussian distributions overlap. The particle separation quality of scintillation detectors depends not only on the detector materials, amplification circuit electronics, or the ADC converter but also on the analytical methods. Because of that ML opens new possibilities in this field by analysing each particle charge event. ML models are already used to analyse different electronic pulses and to detect low-intensity pulses in the background of high noise [8]. Support vector machines (SVM) were used before to increase the accuracy of particle discrimination using organic scintillators in a low-energy area [9]. It was shown that SVM methods can provide better accuracy in charge integration than the PSD method.
Several machine learning methods were compared in Ref. [10]. The results of methods have demonstrated superior performance in the classification of nuclear reactions (6Li + n).
An application of models usually consists of several stages: selection of a suitable algorithm and preparation of its code, training of model parameters using a training data set, evaluation of test data in the algorithm, evaluation of model accuracy and improvement of the model algorithm for better results. The results presented in this work were obtained by analysing the shape of pulses induced by ionizing radiation using an artificial neural network model.
Polyethylene napthtalate (PEN) is a plastic suitable for use as a scintillation detector that does not require additional wavelength shifting dyes [11]. The maximum photoluminescence of this material depends on the luminescent molecules – excimers. The PEN used in the experiments was obtained from a research group at the Max Planck Institute. Polymer preparation and melting technologies are described in Ref. [12]. The physical parameters of the obtained samples are provided in Table 1.
Parameter | Value |
Width | 30 mm |
Length | 30 mm |
Thickness | 3 mm |
Density | 1.33 g/cm3 |
Refractive index | 1.62 |
The photoluminescence peak of PEN is at 445 nm, the spectral measurements were performed using a Thermo Scientific Evolution 220 spectrometer. This material has the properties required for the separation of ionizing radiation because part of the scintillation light emitted after the interaction with the particle is from the TTA energy relaxation process. The shape of pulses varies depending on the type of particle that hits the scintillation detector material. In the case of an interaction with a heavy ionizing radiation particle such as an alpha particle or a recoil proton (because of neutron interaction with matter), the ratio between the delayed fluorescence integral and the total pulse integral is higher than during the interaction with the light ionizing radiation particle, e.g. beta or gamma. The examples of normalized pulses induced by averaged alpha and beta particles are given in Fig. 1. The pulses for Fig. 1 were obtained after the PEN exposure to alpha and beta sources, 238Pu (Emax = 5.5 MeV) and 90Sr/90Y (Emax = 2.2 MeV), respectively. The plot shows that pulses differ in the delayed fluorescence pulse region. The pulse shape difference of neutrons and gammas is similar to that of alphas and betas, differences are explained in the analysis chapter.
The experimental scheme is shown in Fig. 2. PEN detector scintillation light pulses caused by ionizing radiation particles were recorded by a Hamamatsu photomultiplier (H11934-300) with an active window of 23 × 23 mm. The photomultiplier is powered by a high-stability, Ortec 556 high-voltage source using –700 V voltage. The pulses from the photomultiplier are amplified in a preamplifier and recorded by a Picoscope 2206 digital oscilloscope with a resolution of 8 bits and a frequency band of 50 Mhz. The registered pulse window is 2048 ns.
Three data sets were obtained during the experiments: alpha – after the PEN exposure to alpha particle flux (238PuBe source), beta – after the PEN exposure to beta particle flux (90Sr/90Y source) and neutron/gamma – after the PEN exposure to combined neutrons and gamma photon flux (combined 239PuBe and 238PuBe source).
The essence of neutron detection by a scintillation detector is the energy recording of recoil protons in the detector material. Neutrons, similarly to gamma radiation photons, are recorded via the secondary particles, i.e. in both cases analysed pulses are derived from the secondary particles. In the case of interaction with the gamma radiation photon, the interaction of secondary electrons (Compton and photoelectric effect) with the detector is analysed, while in the case of neutron interaction, the interaction of recoil protons is analysed, that is similar to the interaction of the alpha particle with the detector material. The pulse analysis using a comparison of the delayed (QD) and total pulse integral (QT) is plotted in Fig. 3. Here, neutron-induced pulses are plotted in the right part of the graph and gamma in the left part.
As shown in Fig. 3, from a certain threshold (QT < 15000), it becomes undefined what type of particle hits the detector as the areas overlap. From that limit, it is possible to determine only the statistical probability of a specific type of ionizing radiation particle interacting with the detector material. As the energy left by the particle in the detector material decreases, separation errors increase and the accuracy of the particle determination decreases.
An artificial neural network was used to determine the type of particles and to increase the accuracy of detection. Models were developed in the Knime analytics platform [13] environment using python Keras (version 2.2.4) and Tensorflow (version 2.2.0) software packages.
The model was made using 3 Keras network layers (an input layer, a first dense layer with Tanh activation function and a second dense layer with a Sigmoid activation layer). Cross validation was applied to the model to fine-tune parameters, such as the number of the first dense layer ouput units (8 was used as optimal). Other combinations and the quantity of layers did not noticeably improve the quality of the model. The Keras network learner was trained using a maximum of 100 epochs (or till the loss function reaches plateau conditions) with 200 training batches and 200 validation batches. The optimizer was set to Adam with a learning rate equal to 0.001. The binary cross entropy function was used as a loss function in the learning process. A validation data set was used to calculate the loss function value on each epoch.
Data cleaning was applied before training. Cleaning is needed because it is not possible to ensure data reliability due to natural gamma radiation and high-energy cosmic neutron radiation which gives false results.
Models were trained using combined alpha and beta and prepared for training neutron/gamma radiation pulse data sets. The data set of neutron/gamma radiation training contained cleaned and filtered [QT > 15000] pulse information. As mentioned before, neutron/gamma separation information under that threshold is not accurate enough (Fig. 3). Data sets of alpha and beta pulses were chosen for the reliability of their data in the low-energy field. The filtered neutron/ gamma data set was used because alpha and beta data sets do not provide enough information in the high-energy area [QT > 20000].
A comparison of the total and delayed fluorescence integrals of used data sets is presented in Figs. 4 and 5.
The data set (76000 pulses) was divided into three parts: training (70%), testing (24%) and validation (6%) sets.
Whole pulse transient data, as shown in Fig. 1, was used to model training. Each pulse length was equal to 1,024 data points. Before training models, the data was scaled within the limits of each pulse to eliminate possible bad decisions on the absolute value of the pulse height. A trained and tested model was used to determine neutron and gamma ionizing radiation particles from a raw data set obtained by recording the total neutron and gamma flux from a 239PuBe and 238PuBe source.
Figure 6 shows the initial ROC results using the test data set, the area under the curve value equal to 0.98. The area under the ROC curve directly represents the quality of the neutron/gamma discrimination in the test data set.
Raw (not cleaned but normalized) pulse data obtained by recording the total neutron and gamma flux were grouped by a neural network. The results are represented in Fig. 7. Graphs are showing how the proposed model can determine the type of interacting ionizing radiation particles. However, reliable data are obtained only in the energy domain where the verification of separation of particles is possible using mathematical impulse integral comparison methods such as a comparison of QT and QD integrals. The models determine the type of radiation in the low-energy field, but there are currently no tools to guarantee the reliability of the information. Figure 8 shows the difference between the raw data Gaussian distribution and grouped data by ML. It is clear from the graph that distributions are mostly matching and the biggest mismatches are in the 0.1–0.13 integral ratio area. The mentioned area is the region where neutron and gamma pulse integrals are starting to overlap, and it is the most difficult area from a statistics perspective as probabilities of true positive decisions are based on real neutrons and gamma proportion. ML is selecting more neutrons than the normal distribution shows in that region.
The proposed ANN network provides superior performance in the test data set classification. Moreover, the model provides a correct pulse grouping in the high-energy region; however, in the low-energy region more mismatches from the normal distribution appear. Based on a comparison of the statistical model response distribution and raw data normal distribution, it can be stated that the model is statistically correct, although it cannot be stated for each pulse in the low-energy range. Additional models and data preparation methods are needed to increase model accuracy in low-energy regions.
[1] R. Kouzes, J. Ely, A. Lintereur, E. Siciliano, D. Stromswold, and M.L. Woodring, 3He Neutron Detector Pressure Effect and Comparison to Models (Pacific Northwest National Lab. (PNNL), Richland, WA, United States, 2010), https://doi.org/10.2172/971884
[2] M. Grodzicka-Kobylka, T. Szczesniak, L. Swiderski, K. Brylew, M. Moszyński, J. Valiente-Dobón, P. Schotanus, K. Grodzicki, P. Mazerewicz, J. Szymanowski, and Z. Mianowska, Comparison of detectors with pulse shape discrimination capability for simultaneous detection of gammarays, slow and fast neutrons, Nucl. Instrum. Methods Phys. Res. A 1019, 165858 (2021), https://doi.org/10.1016/j.nima.2021.165858
[3] G.H.V. Bertrand, M. Hamel, S. Normand, and F. Sguerra, Pulse shape discrimination between (fast or thermal) neutrons and gamma rays with plastic scintillators: State of the art, Nucl. Instrum. Methods Phys. Res. A 776 (2015), https://doi.org/10.1016/j.nima.2014.12.024
[4] P.N. Zhmurin, V.N. Lebedev, A.F. Adadurov, V.N. Pereymak, and Yu.A. Gurkalenko, Plastic scintillator for pulse shape neutrons and gamma quanta discrimination, Radiat. Meas. 62, 1–5 (2014), https://doi.org/10.1016/j.radmeas.2013.12.013
[5] T. Yanagida, K. Watanabe, and Y. Fujimoto, Comparative study of neutron and gamma-ray pulse shape discrimination of anthracene, stilbene, and p-terphenyl, Nucl. Instrum. Methods Phys. Res. A 784, 111–114 (2015), https://doi.org/10.1016/j.nima.2014.12.031
[6] P. Blanc, M. Hamel, L. Rocha, S. Normand, R. Pansu, F. Gorbert, and I. Lampre, in: Proceedings of 2013 3rd International Conference on Advancements in Nuclear Instrumentation, Measurement Methods and Their Applications (Marseille, France, 2013) pp. 1–9, https://doi.org/10.1109/ANIMMA.2013.6727919
[7] W.G.J. Langeveld, M.J. King, J. Kwong, and D.T. Wakeford, Pulse shape discrimination algorithms, figures of merit, and gamma-rejection for liquid and solid scintillators, IEEE Trans. Nucl. Sci. 64(7), 1801–1809 (2017), https://doi.org/10.1109/TNS.2017.2681654
[8] L. Su, L. Deng, W. Zhu, and S. Zhao, Statistical detection of weak pulse signal under chaotic noise based on Elman neural network, Wirel. Commun. Mob. Comput. 2020, 1–12 (2020), https://doi.org/10.1155/2020/9653586
[9] T.S. Sanderson, C.D. Scott, M. Flaska, J.K. Polack, and S.A. Pozziet, in: Proceedings of 2012 IEEE Nuclear Science Symposium and Medical Imaging Conference Record (NSS/MIC) (2012) pp. 199–202, https://doi.org/10.1109/NSSMIC.2012.6551092
[10] J. Griffiths, S. Kleinegesse, D. Saunders, R. Taylor, and A. Vacheret, Pulse shape discrimination and exploration of scintillation signals using convolutional neural network, Mach. Learn. Sci. Technol. 1(4), 045022 (2020), https://doi.org/10.1088/2632-2153/abb781
[11] J. Garankin, A. Plukis, R. Plukienė, E. Lagzdina, and V. Remeikis, Identification of particles of ionizing radiation by the analysis of fluorescence pulse form of the thin pen film scintillator, IEEE Trans. Nucl. Sci. 65(2), 739–743 (2018), https://doi.org/10.1109/TNS.2017.2785683
[12] Y. Efremenko, L. Fajt, M. Febbraro, F. Fischer, C. Hayward, R. Hodák, T. Kraetzschmar, B. Majorovits, D. Muenstermann, E. Öz, et al., Use of polyethylene naphthalate as a self-vetoing structural material, arXiv:1901.03579 (2019), https://arxiv.org/abs/1901.03579v2
[13] F.V. Ordenes and R. Silipo, Machine learning for marketing on the KNIME Hub: The development of a live repository for marketing applications, J. Bus. Res. 137, 393–410 (2021), https://doi.org/10.1016/j.jbusres.2021.08.036
Santrauka
Jonizuojančiosios spinduliuotės dalelių atskyrimas – svarbi ir sudėtinga užduotis, ypač neutronų ir gama spindulių atžvilgiu. Neutronų ir gama spinduliuotės atskyrimas yra būtinas radiacinės saugos tikslais ir branduolinių reakcijų kontrolei. Standartiniai matematiniai impulsų analizės modeliai gerai veikia, esant didelei dalelės energijos perdavai (>1 MeV). Atskyrimo kokybė prastėja mažėjant perduodamos energijos kiekiui, todėl neįmanoma nustatyti tikslaus dalelės tipo, esant gana žemam energijos perdavos lygiui.
Šiame darbe buvo panaudotas dirbtinio neuroninio tinklo modelis, sprendžiant atskyrimo, esant žemai energijos perdavai, problemą. ML (mašininio mokymosi) modelis buvo naudojamas analizuojant impulsus, gautus iš PEN (polietileno naftalato) scintiliacinio detektoriaus. Dirbtinio neuroninio tinklo modeliams mokyti buvo naudojami duomenų rinkiniai, gauti veikiant PEN detektorių alfa (238Pu šaltinis), beta (90Sr / 90Y šaltinis) ir kombinuotu neutronų ir gama fotonų (239PuBe ir 238PuBe šaltinių mišinys) srautais. Neuroninio tinklo atsako duomenys buvo lyginami su standartiniais matematiniais jonizuojančiosios spinduliuotės atskyrimo būdais, kuriuose naudojamas greitosios ir uždelstosios fluorescencijos santykis. Gauti rezultatai parodė, kad modelis sugeba labai gerai atskirti daleles didelės energijos perdavos srityje, taip pat jis identifikuoja daleles ir mažos energijos perdavos srityje, tačiau nėra įrankių, leidžiančių patikrinti rezultatų patikimumą.