An Image Quality Evaluation Model for Optical Strip Signal-to-Noise Ratio in the Target Area of High Temperature Forgings

Abstract

Under the time-varying temperature, the high-temperature radiation of forgings and the change of reflection characteristics of oxide skin on the surface of forgings lead to the difficulty of obtaining images to truly reflect the geometric characteristics of forgings. It is urgent to study the clear and reliable acquisition method of hot forging feature image under time-varying temperature to meet the requirements of visual measurement of hot geometric parameters of forgings. Based on this, this chapter first puts forward the quality evaluation method of forging feature image, which provides guarantee for the accurate evaluation of feature image quality. Furthermore, the factors that affect the image quality, such as the radiation characteristics of forgings and the photographic characteristics of cameras, are analyzed, and the imaging spectrum which can effectively suppress the radiation intensity of forgings is determined. Finally, aiming at the problem that the quality of image acquisition is difficult to guarantee due to the drastic change of radiation intensity of forgings under time-varying temperature, an image acquisition method based on minimum signal-to-noise ratio (SNR) based laser light intensity adaptation is proposed, which significantly improves the definition of feature light strips in forging images at high temperature, and finally realizes the clear acquisition of feature images of large-scale hot forging under time-varying temperature.

I. INTRODUCTION

1.1. Surface reconstruction

For visual measurement, image quality directly determines the accuracy and reliability of the final measurement results. However, the lighting environment of forging measurement is very complex. Affected by the high temperature radiation, it is difficult to ensure that the images collected at each moment can meet the measurement requirements. Therefore, it is of great significance to evaluate whether the quality of the forging feature image collected in the forging site can meet the measurement requirements.

1.2. Objective image quality evaluation method

The meaning of image quality mainly includes two aspects: image fidelity and image intelligibility. Image quality directly depends on the optical performance of imaging equipment, image contrast, instrument noise and other factors, and quality evaluation can provide monitoring means for image acquisition and processing [1]. To evaluate each link of image processing, the research of image quality evaluation has become one of the basic technologies of image information engineering.

There are already mature subjective evaluation technologies and international standards in the world. For example, ITU-T REC.P.910 specifies the subjective evaluation method for multimedia applications. ITU-R BT.500-11 specifies a subjective evaluation method for television images and specifies in detail the test sequence, personnel, distance, and environment during the subjective evaluation of video quality. MOS Mean Opinion Score is the most representative subjective evaluation method of image quality, which judges image quality by the evaluation of observers [2], [8]. The subjective quality score can be divided into two types: absolute evaluation and relative evaluation.

The objective evaluation method of image quality is to establish a mathematical model based on the subjective vision system of human eyes and calculate the image quality by a specific formula.

Traditional objective evaluation methods for image quality mainly include MSE (Mean squared error) and peak signal to Noise rate (PSNR). The mean square error method first calculates the mean square value of the difference between the original image and the distorted image, and then determines the distortion degree of the distorted image by the mean square value.

For the objective image quality evaluation method, usually feature information in the original reference image according to need how many can be divided into the following three categories: full reference, reference and no reference image quality evaluation method of the reference and the reference to be on the basis of the original reference image evaluation method is used to compress image quality evaluation, and not for forging measurement for reference of the original image; As for the nonreference evaluation method, its biggest advantage is that it does not need any original reference image information [3]. However, this method still has the problem that it is difficult to guarantee the accuracy and reliability of evaluation, and it requires the establishment of corresponding evaluation model for different image features to be measured to realize the reliable evaluation of image quality.

Ⅱ. IMAGE QUALITY EVALUATION MODEL BASED ON TARGET REGION SNR

2.1. Establishment of image quality evaluation model

For the measurement of forging image, the forging image taken at each moment is unique, and there is no original image for reference. Therefore, both full reference and partial reference image quality evaluation methods cannot be directly used for the quality evaluation of forging feature image. However, the accuracy and reliability of the existing non reference methods cannot meet the requirements of on-line accurate evaluation of image quality of forging site, and cannot be directly used for the evaluation of forging image [5]. The advantage of the method proposed in this paper is to use the laser strip projected on the surface of the forging to indirectly characterize the geometric parameters of the forging to be measured, as shown in Fig. 1. At the same time, according to the important information that the laser beam intensity, distribution characteristics and other parameters are known in the process of forging image shooting, the known parameters of laser strip are determined as the reference image feature information, and the image quality evaluation model based on the signal-to-noise ratio of the target area of the forging image is established (image signal to noise ratio, ISNR), as shown in Eq. (1):

\(I S N R=\frac{G_{S l}}{G_{b f}}\)        (1)

where 𝐺_𝑠𝑙 is the peak gray value of laser stripe and 𝐺_𝑏𝑓 is the average gray value of forging background. In this paper, an image evaluation model based on ISNR is established. The peak gray level information of light stripe in the image target area is defined as the image signal, and the background average gray information in the non-light stripe area is defined as noise. The gray value of the noise in the image is composed of three parts: the radiation light of forging, the ambient light of the scene and the dark voltage noise of the camera. Therefore, the higher the signal-to-noise ratio is, the better the image effect is.

2.2. SNR evaluation model based on target region

As shown in Fig.1, Signal to noise ratio is the ratio of signal level to noise level. Impulse noise is usually expressed by peak value, while random noise is represented by root mean square. It is abbreviated as SNR. The normalized signal-to-noise ratio is the ratio of signal energy per bit to the power spectral density of noise, expressed in dB. Or refers to the ratio of signal power to noise power at a certain point in the communication system.

However, due to the complex environment of forging site, the image quality of the forging must be changed at any time under the influence of the forging temperature and illumination conditions. In order to further analyze the influence of these interference factors on the image quality from the theoretical point of view, it is necessary to quantitatively analyze the gray value of each feature information in the image and the forging from the perspective of imaging principle, It is necessary to solve the photoelectric conversion characteristic function of camera CCD and the illumination of different characteristic light intensity in forging site.

2.3. Analysis of the imaging characteristics of camera CCD chip

The image to be tested is directly converted from optical signal received by the lens into analog electrical signal by CCD image sensor to achieve image acquisition. Therefore, the gray value of each pixel in the collected image is determined by the exposure amount and the sensitivity characteristics of CCD chip. According to the photoelectric conversion characteristics of CCD, the relationship between the output signal voltage y and the exposure h received by CCD sensor can be expressed as

\(y=a H^{\gamma}+y_{b}\)         (2)

where 𝑎 is the response rate of CCD (V / LX · s), 𝐻 is the exposure amount (LX · s), γ is the photoelectric conversion coefficient of CCD (γ ≈ 1), 𝑦_𝑏 is the dark voltage (V). For the CCD sensitive chip of camera, a good photosensitive chip should have sensitive light response and low dark voltage. Therefore, 𝑎𝐻 𝛾 is far greater than 𝑦_𝑏. The exposure H can be expressed by the following formula:

\(H=\iint E(\lambda, t) \eta_{s}(\lambda) d \lambda d t\)        (3)

Among them, 𝜂_𝑠(𝜆) is the photosensitive efficiency of CCD chip, which is a function of wavelength 𝜆. 𝑡 ∙ 𝐸 is the illumination at wavelength 𝜆 and time t. 𝐸(𝜆,𝑡) varies with wavelength 𝜆 and time t. In the process of measuring the pictures taken at the scene, in order to avoid the image blur caused by long exposure, the exposure time is usually very short when the image is collected. In this very short exposure time, it can be considered that the instantaneous illumination 𝐸(𝜆,𝑡) is constant, that is, 𝐸(𝜆,𝑡) can be approximately expressed as 𝐸(𝜆) ∙ 𝑡.Then formula (3) can be expressed as follows:

\(H=t \cdot \int E(\lambda) \eta(\lambda) d \lambda=t \cdot E\)           (4)

The output signal voltage y of CCD is represented by the gray value V in the image, and under the same exposure time (T), the exposure amount is determined by the illumination e of CCD, then the relationship between the image gray level and the exposure amount can be expressed by the following formula:

\(G=a k(E t)^{\gamma}+G_{b}\)         (5)

Among them, a is the CCD response rate (V / LX · s), K is the gray value of the image under unit voltage (1 / V), t is the exposure time, E is the total illumination of CCD per unit time, 𝑡 ∙ 𝐸 is the exposure amount, and 𝛾 is the photoelectric conversion coefficient (𝛾 ≈ 𝐿), which is the image gray level caused by dark current. For high quality CCD, 𝑎𝑘(𝐸𝑡)^𝛾 is much greater than 𝐺_𝑏 .

To determine the sensitivity characteristics of the camera chip used in this experiment, the relationship between the gray level of the same feature point image under different parameters and the exposure parameters and light intensity of the camera is collected. The structured light strip images with different exposure parameters under the gain of 0 are respectively collected in the laboratory. The gray values of the corresponding image light stripe are shown in Table 1 As the gray level of image No. 32-36 in Table 1 is supersaturated, the corresponding parameters of figures are used for fitting. The fitting results are shown in Eq. (6).

\(G=10.3 l t \cdot E+0.8\)        (6)

According to the formula (6), the gray level of the image taken by the camera in this experiment has a linear relationship with the exposure amount of CCD and illuminance. The influence of dark current can be ignored. Therefore, Eq. (5) can be simplified as follows:

\(G \approx a t E\)         (7)

The formula (7) is introduced into the formula (1), and the image quality evaluation model (ISNR) is as follows:

\(I S N R=\frac{G_{S l}}{G_{b f}} \approx \frac{a t E_{S l}}{a t E_{b f}}=\frac{E_{S l}}{E_{b f}}\)        (8)

Among them, 𝐸_𝑠𝑙 is the total illumination at the position where the camera receives the laser stripe on the forging surface, and 𝐸_𝑏𝑓 is the total illumination at the position where the camera receives the non-light stripe on the forging surface. 𝐸_𝑠𝑙 and 𝐸_𝑏𝑓 can be calculated from the known parameters of illumination conditions in the forging site. In order to distinguish the image quality signal-to-noise ratio (SNR) obtained by the analysis of the actual collected forging image and the image quality signal-to-noise ratio (SNR) by theoretical analysis, \(I S N R=\frac{G_{S l}}{G_{b f}}\) image quality evaluation model is defined here, and another definition is made \(T I S N R=\frac{E_{s l}}{E_{b f}}\) be a theoretical image quality evaluation model.

2.4. Theoretical image quality evaluation model

In order to determine the influence of forging temperature change, field illumination condition change, laser assisted light intensity and other factors on the image quality of forgings [6], it is necessary to further study the theoretical signal-to-noise ratio image quality evaluation model (𝑇𝐼𝑆𝑁𝑅), which can be expressed as follows:

Table 1. The gray values of the corresponding image light.

\(\operatorname{TISNR}=\frac{E_{S l}}{E_{b f}}=\frac{E_{l}(P)+E_{f}(T)+E_{a}}{E_{f}(T)+E_{a}}\)         (9)

Among them, 𝐸_𝑙(𝑃) is the illumination that the camera receives the laser reflected light on the surface of the forging, 𝐸_𝑓(𝑇) is the illumination of the camera receiving the high temperature forging itself, and 𝐸_𝑎 is the illumination of the environment light reflected by the forging surface. 𝐸_𝑙(𝑃) and 𝐸_𝑓(𝑇) can be calculated directly, and 𝐸_𝑎 can be calculated indirectly by measuring the field illumination. The specific formula is deduced as follows:

The camera receives the irradiance of high temperature forging itself 𝐸_𝑓(𝑇).

The thermal radiation characteristics of high-temperature forgings are similar to those of black body, so the radiation characteristics of high-temperature forgings can be approximately expressed by the formula of black body radiation characteristics. Generally, the functional relationship between spectral radiance of black body and temperature and wavelength can be derived from Planck quantum statistical theory of thermal radiation:

\(M_{0}(\lambda, T)=\frac{2 \pi c^{2} h}{\frac{h c}{\lambda^{5}\left(e^{\lambda k T}-1\right)}}=\frac{c_{1}}{\frac{c_{1}}{\lambda^{5}\left(e^{\lambda T}-1\right)}} W /\left(m^{2} \cdot \mu m\right)\)         (10)

Among them, 𝜆 is the wavelength 𝜇𝑚 , 𝑇 is the absolute temperature 𝑘 ; ℎ is the Planck constant 6.626176 × 10−³⁴𝑊 ∙ 𝑠² ; 𝑐 is the velocity of light in vacuum (2.99792438 × 10⁸𝑚 ∙ 𝑠⁻¹ ); k is the Boltzmann constant (1.380662 × 10⁸𝑊 ∙ 𝑠 ∙ 𝐾⁻¹ ); the first radiation is 𝑐₁ = 2𝜋ℎ𝑐² = 3.7418 × 10⁻¹⁶𝑊 ∙ 𝑚² ; the second radiation is 𝑐₂ = ℎ𝑐/𝑘 = 1.4388 × 10⁻²𝑚 ∙ 𝐾 , Substituting the above parameters into:

\(M_{f}(\lambda, T)=10^{4} \cdot \frac{37420}{\lambda^{5}} \cdot \frac{1}{e^{\frac{14388}{\lambda T}}-1} W /\left(m^{2} \cdot \mu m\right)\)         (11)

Taking any element surface ds on the forging surface, the spectral radiation flux Φ_𝑓 of the forging surface can be obtained as:

\(\Phi_{f}(\lambda, T)=M_{f}(\lambda, T) \cdot d s\)        (12)

The spectral radiation intensity 𝐼_𝑓 of high temperature forging can be expressed as follows:

\(I_{f}(\lambda, T)=\Phi_{f}(\lambda, T) / \Omega_{0}\)        (13)

Among them, Ω₀ is the total solid angle of the forging micro element surface ds, as shown in Fig. 2. The exit solid angle q of the sensitive area of the lens relative to the origin of the micro element surface of the forging can be expressed by the following formula:

\(\Omega_{c}=\frac{\pi r^{2} \cos \theta}{d^{2}}\)         (14)

Among them, r is the radius of the lens, d is the distance from the forging micro surface to the lens, and 𝜃 is the angle between the normal of the forging micro surface ds and the lens light.

According to the formula (14) and (15), the spectral radiation energy Ω_𝑐(𝜆, 𝑇) received by the lens is as follows:

Fig. 2. The schematic diagram of spatial relation of measurement system.

\(\Omega_{c}(\lambda, T)=I_{f}(\lambda, T) \cdot \Omega\)         (15)

According to the above formula, the spectral irradiance of the forging at the lens can be obtained as follows:

\(E_{f}(\lambda, T)=I_{f}(\lambda, T) \cdot \Omega\)        (16)

Finally, Eqs. (12) ~ (13) is introduced into Eq. (17), and the spectral irradiance of forging at lens can be expressed as follows:

\(E_{f}(\lambda, T)=\frac{M_{f}(\lambda, T) \cdot d s \cdot \cos \theta}{\Omega_{0} \cdot d^{2}}\)        (17)

After considering the sensitivity of the camera CCD chip and the unit wavelength transmittance of the filter, the total irradiance 𝐸_𝑓(𝑇) of the camera CCD chip receiving the high temperature forging can be obtained as follows:

\(E_{f}(T)=\int_{\lambda_{\min }}^{\lambda_{\max }} E_{f}(\lambda, T) \cdot \eta_{\operatorname{ccd}(\lambda)} \cdot \mu_{(\lambda)} d \lambda\)         (18)

Among them, 𝜂_𝑐𝑐𝑑(𝜆) is the spectral sensitivity characteristics of CCD chip at wavelength 𝜆, 𝜇_(𝜆) is the spectral transmittance within the filter pass band, and (𝜆_𝑚𝑖𝑛,𝜆_𝑚𝑎𝑥) is the pass band range of the filter.

\(E_{f}(T)=\frac{\varepsilon \cdot d s \cdot \cos \theta}{\Omega_{0} \cdot d^{2}} \cdot \int_{\lambda_{\min }}^{\lambda_{\max }} M_{0}(\lambda, T) \cdot \eta_{\operatorname{ccd}(\lambda)} \cdot \mu_{(\lambda)} d \lambda\)        (19)

Among them, 𝑀₀(𝜆, 𝑇) is Planck black body radiation formula; 𝜆 is wavelength, T is Kelvin temperature, 𝜀 is surface emissivity of forging, ds is any micro surface on forging surface, 𝜃 is angle between ds normal vector and camera optical axis, 𝜂_𝑐𝑐𝑑(𝜆) is spectral response characteristic of CCD, 𝜇(𝜆) is spectral transmittance of filter, Ω₀ is total solid angle of forging emission, d is distance between forging and camera, (𝜆_𝑚𝑖𝑛,𝜆_𝑚𝑎𝑥) is pass band range of filter.

2.5. The camera receives the laser reflected light

The camera receives the laser reflected light intensity 𝐸₁(𝑃) on the surface of high temperature forging [7].

The illuminance of laser reflected light stripe on forging surface can be obtained by analyzing laser irradiation characteristics and forging reflection characteristics. The illumination 𝐸_𝑙1 of laser stripe on the surface of forging is expressed as follows:

\(E_{l 1}=\frac{P_{l}}{S}=\frac{P_{l}}{5.75 \times 10^{-3} \cdot d_{2}^{2} / \cos \theta_{1}}\)          (20)

Among them, 𝑃_𝑙 is the laser output power (W), s is the irradiation area of the light strip at the forging (𝑚² ), 𝑑₂ is the distance between the laser and the forging (m), and 𝜃₁ is the angle between the laser output optical axis and the normal direction of the irradiated forging surface, as shown in Fig. 2. The laser reflected light emissivity of forging surface is 𝑀_𝑙 , 𝜀 is the surface emissivity of forgings.

\(M_{l}=(1-\varepsilon) \cdot E_{l}\)         (21)

The calculation process of irradiance 𝐸_𝑙2 of receiving laser reflected light at the lens is the same as formula 𝐸_𝑓 (𝜆, 𝑇), that is, 𝐸_𝑙2 can be expressed as:

\(E_{l 2}=\frac{M_{l} \cdot d s \cdot \cos \theta}{\Omega_{0} \cdot d^{2}}\)          (22)

Taking into account the sensitivity of the camera and the luminous efficiency of the filter, the camera receives the laser reflected light intensity 𝐸_𝑙(𝑃)on the surface of the high-temperature forging piece as follows:

\(E_{l}(P)=\frac{(1-\varepsilon) \cdot d s \cdot \cos \theta \cdot \cos \theta_{1} \cdot \eta_{\operatorname{ccd}(\lambda)} \cdot \mu_{(\lambda)}}{5.75 \times 10^{-3} \cdot d_{2}^{2} \cdot \Omega_{0} \cdot d^{2}} \cdot P\)         (23)

The surface emissivity of forging 𝜀 is laser power, 𝑃 is any micro surface on the forging surface, 𝑑𝑠 is the angle between the normal vector and the optical axis of the camera, 𝜃 is the angle between the normal vector of the forging surface and the laser incident direction, 𝜂_𝑐𝑐𝑑(𝜆) is the CCD sensitivity response value when the laser wavelength is 𝜆, 𝜇(𝜆) is the filter transmittance when the laser wavelength is 𝜆 , 𝑑₂ is the distance between the laser and the forging, Ω₀ is the total solid angle of the forging part emission, and d is the distance between the forging piece and the camera.

Camera receives ambient reflection illumination 𝐸_𝑎 on the surface of high temperature forging: Similar to the solution process of camera receiving laser reflected illuminance 𝐸_𝑙(𝑃) on the surface of high-temperature forgings, the ambient reflected illuminance 𝐸_𝑎 can be expressed as follows:

\(E_{a}=\frac{(1-\varepsilon) \cdot d s \cdot \cos \theta \cdot \eta_{c c d}(\lambda)}{\Omega_{0} \cdot d^{2}} \cdot E\)         (24)

Among them, 𝐸 is the illumination measurement value of ambient light after passing through the filter, 𝜀 is the surface emissivity of forging piece, 𝜃 is the angle between ds normal vector and camera optical axis, 𝜂𝑐𝑐𝑑 is CCD spectral response coefficient, Ω₀ is the total solid angle of forging emission, and 𝑑 is the distance between forging and camera. All parameters involved in formula (19), (23), (24), except forging temperature T, filter pass band range (𝜆_𝑚𝑖𝑛,𝜆_𝑚𝑎𝑥) and filter spectral transmittance in formula (19), laser output power 𝜇(𝜆) in formula (24) and illuminance measurement value P of ambient light behind filter in formula (24), other parameters are related to hardware and space layout of measurement system Number, which is a constant after the system is built. Among them, 𝜂𝑐𝑐𝑑 is determined by camera CCD chip, 𝜀 and Ω₀ are determined by forging material characteristics, shape and other factors, 𝑑₁ , 𝑑₂ , 𝜃 and 𝜃₁ are determined by the layout of measurement system, which can be measured respectively after the measurement system layout is completed. According to the theoretical image quality evaluation model 𝑇𝐼𝑆𝑁𝑅, the main factors affecting the image quality of the forging are the impact of the forging radiation intensity and the environmental interference light, and the light intensity of the auxiliary laser is also a key factor affecting the image acquisition quality [9].

III. CONCLUSION

It can be seen from the above section that the higher the signal-to-noise ratio of the image quality evaluation model established in this paper, the clearer the image is. Several key factors affecting the signal-to-noise ratio of the collected image are forging temperature T , the selected imaging spectral band range (𝜆_𝑚𝑖𝑛,𝜆_𝑚𝑎𝑥) ,laser output power P, and the interference light intensity of the scene environment E. Therefore, in order to obtain a clear forging image which can meet the measurement requirements, it is necessary to determine the imaging spectral band range, laser power and other parameters. Therefore, firstly, the radiation characteristics of forgings under different temperatures and wavelengths, the photosensitive characteristics of CCD camera, and the light transmission characteristics of common filters are analyzed. Then, the image quality evaluation model proposed in the previous paper is used as the evaluation standard, and the forging image acquisition method meeting the minimum signal-tonoise ratio is proposed. Finally, the appropriate passband meeting the measurement requirements is determined Range and laser output characteristic parameters. In conclusion, the theoretical signal-to-noise ratio image quality evaluation model proposed in this paper can directly analyze the variation law of the theoretical image quality signal-to noise ratio when the forging temperature, auxiliary laser intensity and filter pass band range affect the image acquisition quality, which provides a theoretical basis for the realization of clear forging feature image acquisition in forging field.

In the future experimental work, the corresponding clear image acquisition method can be established based on the image quality evaluation model provided in this paper, and the image acquired by the image acquisition method can also be evaluated by the evaluation method proposed in this paper.