• 제목/요약/키워드: MDP

검색결과 263건 처리시간 0.025초

Q Learning MDP Approach to Mitigate Jamming Attack Using Stochastic Game Theory Modelling With WQLA in Cognitive Radio Networks

  • Vimal, S.;Robinson, Y. Harold;Kaliappan, M.;Pasupathi, Subbulakshmi;Suresh, A.
    • Journal of Platform Technology
    • /
    • 제9권1호
    • /
    • pp.3-14
    • /
    • 2021
  • Cognitive Radio network (CR) is a promising paradigm that helps the unlicensed user (Secondary User) to analyse the spectrum and coordinate the spectrum access to support the creation of common control channel (CCC). The cooperation of secondary users and broadcasting between them is done through transmitting messages in CCC. In case, if the control channels may get jammed and it may directly degrade the network's performance and under such scenario jammers will devastate the control channels. Hopping sequences may be one of the predominant approaches and it may be used to fight against this problem to confront jammer. The jamming attack can be alleviated using one of the game modelling approach and in this proposed scheme stochastic games has been analysed with more single users to provide the flexible control channels against intrusive attacks by mentioning the states of each player, strategies ,actions and players reward. The proposed work uses a modern player action and better strategic view on game theoretic modelling is stochastic game theory has been taken in to consideration and applied to prevent the jamming attack in CR network. The selection of decision is based on Q learning approach to mitigate the jamming nodes using the optimal MDP decision process

제어 장벽함수를 이용한 안전한 행동 영역 탐색과 제어 매개변수의 실시간 적응 (Online Adaptation of Control Parameters with Safe Exploration by Control Barrier Function)

  • 김수영;손흥선
    • 로봇학회논문지
    • /
    • 제17권1호
    • /
    • pp.76-85
    • /
    • 2022
  • One of the most fundamental challenges when designing controllers for dynamic systems is the adjustment of controller parameters. Usually the system model is used to get the initial controller, but eventually the controller parameters must be manually adjusted in the real system to achieve the best performance. To avoid this manual tuning step, data-driven methods such as machine learning were used. Recently, reinforcement learning became one alternative of this problem to be considered as an agent learns policies in large state space with trial-and-error Markov Decision Process (MDP) which is widely used in the field of robotics. However, on initial training step, as an agent tries to explore to the new state space with random action and acts directly on the controller parameters in real systems, MDP can lead the system safety-critical system failures. Therefore, the issue of 'safe exploration' became important. In this paper we meet 'safe exploration' condition with Control Barrier Function (CBF) which converts direct constraints on the state space to the implicit constraint of the control inputs. Given an initial low-performance controller, it automatically optimizes the parameters of the control law while ensuring safety by the CBF so that the agent can learn how to predict and control unknown and often stochastic environments. Simulation results on a quadrotor UAV indicate that the proposed method can safely optimize controller parameters quickly and automatically.

Hydroxyapatite 안구보충물삽입술 후 골신티그라피를 이용한 섬유혈관증식 평가: 평면영상과 SPECT 영상에서의 비교 (Assessment of Vascularization within Hydroxyapatite Ocular Implant by Bone Scintigraphy: Comparative Analysis of Planar and SPECT Imaging)

  • 임석태;손명희;박순아
    • 대한핵의학회지
    • /
    • 제33권6호
    • /
    • pp.475-483
    • /
    • 1999
  • 목적: 안구보충물로 사용된 hydroxyapatite 내로의 섬유혈관증식은 이물질 반응으로 인한 염증의 동반없이 의안의 운동성을 유지시키기 위한 운동성 나사못을 삽입하는데 중요한 역할을 한다. 안구보충물 삽입술 후에 섬유혈관증식의 정도를 알아보는데 Tc-99m MDP를 이용한 평면영상과 단면영상에서 정성적 평가와 정량적 평가의 비교분석을 함으로서 완전한 섬유혈관증식을 예측하는데 단면영상의 유용성을 알아보고자 하였다. 대상 및 방법: 안구 제거술후 hydroxyapatite를 이용하여 안구보충술을 시행받고 $197{\pm}81$일 후에 골신티그라피를 시행받은 17명의 환자(남:녀=12:5, 연령; $50.4{\pm}17.5$세)의 18예를 대상으로 하였다. 골신티그라피는 Tc-99m MDP 740 MBq를 정맥주사 후 4시간 경과뒤에 이중헤드 감마카메라(ECAM, Siemens, Germany)로 안면부 평면영상을 얻은 후 이어서 단면영상을 얻었다. 평면영상과 단면영상에서의 안구보충물의 방사능 섭취가 비교(nasal bridge)보다 약한 경우를 grade 1, 비슷한 경우를 grade 2, 강한 경우를 grade 3로 평가하였고, 정상안구에 대한 안구보충물의 섭취비를 정량적으로 구하여 운동성 나사못 삽입술 후 시행된 세극등 검사에서 염증반응의 동반 없이 완전한 섬유혈관증식을 보인 환자 군과 염증 반응의 동반과 함께 불완전한 섬유혈관증식을 보인 환자 군으로 나누어 비교 분석하였다. 결과: 평면영상에서 grade 1은 9예, grade 2가 1예, grade 3가 2예로 충분한 섬유혈관증식을 의미하는 grade 2와 3를 보인 경우가 9예 (50%) 이었으나 단면영상에서는 grade 1이 6예, grade 2가 4예, grade 3가 8예로 평면영상에 비하여 grade 2와 3를 보이는 경우가 12예(61%) 이었다. 정성적 평가에 의한 완전한 섬유혈관증식을 예측하는 데 있어서 평면영상은 예민도가 60% (9/15),특이도 100% (3/3), 양성예측률 100% (9/9), 음성예측률 33.3% (3/9), 정확도 66.7% (12/18) 이었고 단면영상은 예민도 80% (12/15), 특이도 100% (3/3), 양성예측률 100% (12/12), 음성예측률 50% (3/6), 정확도 83.3% (15/18) 이었다. 정량적으로 구한 안구보충물 내의 방사능 섭취비는 평면영상에서 grade 1은 $1.19{\pm}0.10$, grade 2는 $2.16{\pm}0.43$, grade 3는 $3.57{\pm}0.74$로 grade가 높을수록 정량적 섭취비가 유의하게 증가하였다(p<0.001). 단면영상에서 grade 1은 $3.06{\pm}1.22$, grade 2는 $3.71{\pm}0.83$, grade 3는 $12.49{\pm}4.31$로 grade가 높을수록 정량적 섭취비가 유의하게 증가하였다(p<0.001). 완전한 섬유혈관증식을 보인 환자 군과 불완전한 섬유혈관증식을 보인 환자군으로 나누어 정량적으로 측정한 방사능 섭취비를 비교시 평면영상에서는 $1.96{\pm}0.87$$1.17{\pm}0.08$로 유의한 차이를 보이지 않았으나 단면영상에서는 $8.44{\pm}5.45$$2.20{\pm}0.87$로 유의한 차이를 보였다 (p<0.05). 결론: 안구보충물 삽입 후 섬유혈관증식을 평가할 때 평면영상에 비하여 단면영상이 섬유혈관증식 정도를 평가하는데 보다 도움을 주었다.

  • PDF

동방결절 활동전압에 대한 아데노신 효과 (Effects of Adenosine on the Action Potentials of Rabbit SA Nodal Cells)

  • 김기환;호원경
    • The Korean Journal of Physiology
    • /
    • 제18권1호
    • /
    • pp.19-35
    • /
    • 1984
  • Since the first report of Drury and $Szent-Gy{\ddot{o}}rgyi$ in 1929, the inhibitory influences of adenosine on the heart have repeatedly been described by many investigators. These studies have shown that adenosine and adenine nucleotides have overall depressant effects, similar to those of acetylcholine. Heart beats become slow and weak. It is also well known that adenosine is a potent endogenous coronary vasodilator. Many investigations on the working mechanisms of adenosine have been focused mainly on the effects of the coronary blood flow. However, the cellular mechanisms underlying the inhibitory action of adenosine on sinus node are not well understood yet. Thus, this study was undertaken to examine the behavior of rabbit SA node under influence of adenosine. In these series of experiments three kinds of preparations were used: whole atrial pair, left atrial strip, and isolated SA node preparations. The electrical activity of SA node was recorded with conventional glass microelectrodes 30 to 50 $M{\Omega}$. The preparations were superfused with bicarbonate-buffered Tyrode solution of pH 7.35 and aerated with a gas mixture of $3%\;CO_2-97%\;O_2$ at $35^{\circ}C$. In whole atrial pair, adenosine suppressed sinoatrial rhythm in a dose-dependent manner. Effect of adenosine on atrial rate appeared at the concentration of $10^{-5}M$ and was enhanced in parallel with the increase in adenosine concentration. Inhibitory action of adenosine on pacemaker activity was more prominent in the preparation pretreated with norepinephrine, which can steepen the slope of pacemaker potential by increasing permeability of $Ca^{+2}$. Calcium ions in perfusate slowly produced a marked change in sinoatrial rhythm. Elevation of the calcium concentration from 0.3 to 8 mM increased the atrial rate from 132 to 174 beats/min, but over 10 mM $Ca^{+2}$ decreased. The inhibitory effect of adenosine on sinoatrial rhythm developed very rapidly. Atrial rate was recovered promptly from the adenosine-induced suppression by the addition of norepinephrine, but extra $Ca^{+2}$ was less suitable to restore the suppression of atrial rate. Adenosine suppressed also atrial contractility in the same dosage range that restricted pacemaker activity, even in the reserpinized preparation. In isolated SA node preparation, spontaneous firing rate of SA node at $35^{\circ}C$(mean{\pm}SEM, n=16) was $154{\pm}3.3\;beats/min. The parameters of action potentials were: maximum diastolic potential(MDP), $-73{\pm}1.7\;mV: overshoot(OS), $9{\pm}1.4\;mV: slope of pacemaker potential(SPP), $94{\pm}3.0\;mV/sec. Adenosine suppressed the firing rate of SA node in a dose-dependent manner. This inhibitory effect appeared at the concentration of $10^{-6}M$ and was in parallel with the increase in adenosine concentration. Changes in action potential by adenosine were dose-dependent increase of MDP and decrease of SPP until $10^{-4}M$. Above this concentration, however, the amplitude of action potential decreased markedly due to the simultaneous decrease of both MDP and OS. All these effects of adenosine were not affected by pretreatment of atropine and propranolol. Lowering extra $Ca^{2+}$ irom 2 mM to 0.3 mM resulted in a marked decrease of OS and SPP, but almost no change of MDP. However, increase of perfusate $Ca^{2+}$ from 2 mM to 6 or 8 mM produced a prominent decrease of MDP and a slight increase of OS and SPP. Dipyridamole(DPM), which is known to block the adenosine transport across the cell membrane, definately potentiated the action of adenosine. The results of this experiment suggest that adenosine suppressed pacemaker activity and atrial contractility simultaneously and directly, by decreasing $Ca^{2+}-permeability$ of nodal and atrial cell membranes.

  • PDF

고령 불임여성의 체외수정술시 최소자극법의 효용성 (Minimal Stimulation using rhFSH and GnRH Antagonist for IVF Treated Patients of Advanced Age)

  • 김소라;김정훈;이진경;전균호;김성훈;채희동;강병문
    • Clinical and Experimental Reproductive Medicine
    • /
    • 제36권1호
    • /
    • pp.63-70
    • /
    • 2009
  • 목 적: 본 연구는 전향적 무작위 배정법 연구로 40세 이상의 불임여성의 자연주기에서 소량의 재조합난포자극호르몬을 이용한 최소자극법의 효과를 성선자극호르몬분비호르몬길항제 다회투여법과 비교 분석하고자 한다. 연구방법: 불임크리닉을 방문하였던 환자들 중 나이가 40세 이상인 75명 환자들을 대상으로 시행하였다. 연구군은 최소자극법으로 37명, 대조군은 성선자극호르몬분비호르몬길항제 다회투여법으로 38명의 환자들로 구성되었으며 모두 체외수정시술을 시행 받았다. 주기 취소율, 난포자극호르몬 종 사용량과 일수, 성숙난자의 수, 이식된 배아의 수, 배아이식 주기당 임신율, 착상율 등을 비교하였으며, 통계학적인 방법은 평균값의 비교를 위하여 Student's t-test를 이용하였고 분율의 비교를 위하여 ${\chi}^2$ 검정, Fisher's exact test를 사용하였으며, p값이 0.05 미만인 경우에 통계학적으로 유의하다고 판정하였다. 결 과: 두 군간의 대상 환자들의 기본적인 특성은 차이가 없었다. rhFSH의 투여기간과 총용량에서 연구군의 경우 4.5${\pm}$1.2일, 632.2${\pm}$123.7 IU로 대조군에서의 11.3${\pm}$2.7일, 3124.6${\pm}$452.1 IU에 비하여 통계학적으로 유의하게 낮은 값을 보였고, 주기 취소율은 연구군에서 16.2%, 대조군에서 5.3%로 통계적으로 유의성은 없었다. 회수된 난자의 수, 성숙한 제 2감수분열 중기 상태의 난자의 수 및 수정된 난자의 수, 양질의 배아수, 배아이식된 배아의 수에 있어서 대조군에 비해서 연구군에서 통계적으로 유의하게 낮았다. 배란유도를 시작한 주기당 임상적 임신율과 배아이식 주기당 임상적임신율은 연구군의 경우 각각 10.8%와 13.4%로 대조군에서 13.2%와 13.9%에 비하여 다소 낮긴 하였으나 통계학적으로 유의성은 없었다. 착상율, 자연유산율에서는 두 군간의 차이가 없었다. 결 론: 40세 이상의 고령 여성에서 체외수정술을 시행하고자 할 때 배란유도의 방법으로 GnRH antagonist와 성선자극호르몬을 이용한 최소자극법은 성선자극호르몬분비호르몬길항제 다회투여법과 비교하여 임신율이 감소하지 않으며 비용면에서 효율적이고 효과적인 방법이다.

악성종양의 임상적 병기에 따른 $^{99m}Tc-MDP$ 골주사의 비교관찰 ($^{99m}Tc-MDP$ Bone Scan Findings in Various Clinical Stages of Malignancies)

  • 윤휘중;이명철;조보연;김노경;고창순
    • 대한핵의학회지
    • /
    • 제15권2호
    • /
    • pp.1-9
    • /
    • 1981
  • Bone scans with $^{99m}Tc-MDP$ (methylene diphosphonate) were obtained and analysed in 574 patients with biopsy-proven malignancy, who visited Seoul National University Hospital from April, 1979 to June, 1931. Clinical staging was done in all patients without bone scan information and compared with bone scan to determine the predictive value of bone scanning. 1. Primary site of the maligancies were lung in 152, breast in 97, stomach in 43, colon in 15, esophagus in 9, liver and pancreas in 11, kidney in 14, bladder in 27, prostate in 22, thyroid in 20, skin in 11, bone in 9, head and neck in 36, ovary and uterus in 17, hematopoietic and lymphoretic ular system in 33, nervous system in 10, and others in 9 cases. Primary site was not defined in 39 cases. 2. Bone scans were positive in 186 cases (32.4%), which, included 48 cases (31.6%) of lung cancer, 27 cases (27.8%) of breast cancer, 12 cases(28%) of stomach cancer, 6 cases(40%) of colon cancer, 6 cases(43%) of kidney tumor, 4 cases(15%) of bladder cancer, 14 cases(64%) of prostate cancer, 3 cases(15%) of thyroid cancer and 66 other cases. 3. Bone scans were suspicious in 64 cases (11.2%) which included 29 cases (19.1%) of lung cancer, 10 cases (10.3%) of breast cancer, 4 cases (9.3%) of stomach cancer, one case (7%) of colon cancer, 3 cases(11%) of bladder cancer, 2 cases(10%) of thyroid cancer and 15 other cases. 4. Out of 121 cases with early stage of malignancy (which included 20 cases of lung cancer in stage I, II, 38 cases of breast cancer, 13 cases of stomach cancer, 8 cases of kidney tumor, 14 cases of thyroid cancer in stage $I{\sim}III$, and 6 cases of colon cancer, 14 cases of bladder cancer, 8 cases of prostate cancer in stage $A{\sim}C$, bone scans were positive in 5 cases (4.1%) which included 3 cases of lung cancer one case of breast cancer and one case of prostate cancer, and considered as further advanced stage. Out of 121 cases with early stage of malgnancy, bone scans were suspicious in 21 cases (17.4%) which inlcuded 9 cases of lung cancer, 4 cases of breast cancer, 2 cases of stomach cancer, one case of colon cancer, 3 cases of bladder cancer, and 2 cases of thyroid cancer. From these results, we concluded bone scan was useful in detecting bone metastasis in patients of early stage of malignancy, determining prognosis and establishing therapentic plan.

  • PDF

Effectiveness of GnRH antagonist multiple dose protocol applied during early and late follicular phase compared with GnRH agonist long protocol in non-obese and obese patients with polycystic ovary syndrome undergoing IVF/ICSI

  • Kim, Chung-Hoon;Moon, Jei-Won;Kang, Hyuk-Jae;Ahn, Jun-Woo;Kim, Sung-Hoon;Chae, Hee-Dong;Kang, Byung-Moon
    • Clinical and Experimental Reproductive Medicine
    • /
    • 제39권1호
    • /
    • pp.22-27
    • /
    • 2012
  • Objective: To evaluate the effectiveness of GnRH antagonist multiple dose protocol applied during early and late follicular phase (MDP-EL) in comparison with standard GnRH agonist luteal long protocol (LP) in each non-obese and obese polycystic ovary syndrome (PCOS) women undergoing IVF. Methods: Two hundred eleven infertile women with PCOS were recruited and randomized to undergo either GnRH antagonist MDP-EL (antagonist group) or standard GnRH agonist luteal LP (agonist group). IVF cycle outcomes were compared between the two groups. Results: Total dose and days of recombinant human follicle stimulating hormone (rhFSH) administered were significantly fewer in the antagonist group than in the agonist group. Incidence of severe ovarian hyperstimulation syndrome was significantly lower in the antagonist group. However, IVF and pregnancy outcomes were similar in the two groups. When all subjects were divided into non-obese and obese subgroups, in non-obese PCOS subgroup, IVF and pregnancy outcomes were comparable in the antagonist and agonist groups but total dose and days of rhFSH were also significantly fewer in the antagonist group. Similar findings were also observed in obese PCOS subgroup. Conclusion: GnRH antagonist MDP-EL is at least as effective as GnRH agonist LP and may be a more patient-friendly alternative in controlled ovarian stimulation for PCOS patients undergoing IVF, independent of body mass index.

동방결절 전기적 특성에 대한 $Ca^{2+}$ 효과의 온도에 따른 변화 (Temperature-dependency of $Ca^{2+}$ Effect on the Electrical Activity of Rabbit SA Node)

  • 호원경;김기환;황상익
    • The Korean Journal of Physiology
    • /
    • 제21권1호
    • /
    • pp.1-12
    • /
    • 1987
  • There is evidence that the effect of extracellular $Ca^{2+}$ on heart rate is temperature-dependent: at $38^{\circ}C$ excess $Ca^{2+}$ induces positive chronotropic response, whereas at $30^{\circ}C$ there is no significant chronotropic effect of $Ca^{2+}$. The cause of this temperature-dependency, however, remains still unclear. Therefore, this study was undertaken to investigate the chronotropic effect of external $Ca^{2+}$ at different temperature in the isolated rabbit atria and in the small strips of SA node cut perpendicularly to crista terminalis. In the isolated atria, the $Ca^{2+}$ effect was temperature-dependent: at $35^{\circ}C$ excess $Ca^{2+}$ evoked positive chronotropic response, while at $30^{\circ}C$ there was no significant changes in sinus rate. On the contrary, in the small SA strips external $Ca^{2+}$ induced negative chronotropic effect. At $35^{\circ}C$ changes in $Ca^{2+}$ concentration from 2 to 4, 6, and 10 mM decreased the sinus rate by $2.7{\pm}1.6%$, $11.2{\pm}3.7%$ and $23.2{\pm}8.1%$ respectively. Lowering the temperature to $30^{\circ}C$, the negative chronotropic effect of $Ca^{2+}$ became greater. With intracellular microelectrodes transmembrane potential was recorded in the small SA strips at $30^{\circ}C$, $35^{\circ}C$ and $38^{\circ}C$. As temperature increased from 30 to $38^{\circ}C$, sinus rate was accelerated by $13/min/^{\circ}C$, $APD_{50}$(action ptential duration from peak to 50% repolarization) decreased by $5\;msec/^{\circ}C$, and amplitude of action potential was slightly decreased. With an increase in $Ca^{2+}$ concentrations from 0.5 to 6 mM, overshoot increased and MDP decreased. These $Ca^{2+}$ effects on the overshoot and MDP of action potentials were not altered by temperature. But the $Ca^{2+}$ effects on the rates of diastolic depolarization, systolic depolarization and repolarization were modified by temperature. Discrpancy of the chronotropic effects of $Ca^{2+}$ between isolated atria and small SA strips was discussed.

  • PDF

Effect of liners and primers on tensile bond strength between zirconia and resin-based luting agent

  • Jo, Eun-Hye;Huh, Yoon-Hyuk;Ko, Kyung-Ho;Park, Chan-Jin;Cho, Lee-Ra
    • The Journal of Advanced Prosthodontics
    • /
    • 제10권5호
    • /
    • pp.374-380
    • /
    • 2018
  • PURPOSE. The effect of silica-based glass-ceramic liners on the tensile bond strength between zirconia and resin-based luting agent was evaluated and compared with the effect of 10-methacryloyloxydecyl dihydrogen phosphate (MDP)-containing primers. MATERIALS AND METHODS. Titanium abutments and zirconia crowns (n = 60) were fabricated, and the adhesive surfaces of the specimens were treated by airborne-particle abrasion. The specimens were divided into 5 groups based on surface treatment: a control group, 2 primer groups (MP: Monobond Plus; ZP: Z Prime Plus), and 2 liner groups (PL: P-containing Liner; PFL: P-free Liner). All specimens were cemented with self-adhesive resin-based luting agent. After 24-hour water storage and thermocycling (5,000 cycles, $5^{\circ}C/55^{\circ}C$), the tensile bond strength was measured using a universal testing machine. Failure mode analysis and elemental analysis on the bonding interface were performed. The data were analyzed using Kruskal-Wallis test, Dunn's post hoc test, and Fisher's exact test. RESULTS. The liner groups and primer groups showed significantly higher tensile bond strengths than that of the control group (P<.05). PFL showed a significantly higher tensile bond strength than the primer groups (P<.05). The percentage of mixed failure was higher in the primer groups than in the control group (P<.001), and all the specimens showed mixed failure in the liner groups (P<.001). A chemical reaction area was observed at the bonding interface between zirconia and liner. CONCLUSION. The application of liner significantly increased the tensile bond strength between zirconia and resin-based luting agent. PFL was more effective than MDP-containing primers in improving the tensile bond strength with the resin-based luting agent.

퇴행성 슬관절염에 대한 핵의학적 고찰 (The nuclear medicinal study on degenerative arthritis of knee joint using traditional acupuncture)

  • 김영규;박소영;고강훈;윤민영;진경선;장병선;오희홍;김성철;황우준;송호천;안수기
    • Journal of Acupuncture Research
    • /
    • 제19권1호
    • /
    • pp.127-134
    • /
    • 2002
  • Background and Purpose : Now, a lot of people are suffering from arthritis of knee joint. Western and oriental medicine, all of them are trying various methods to cure this disease, but generally the grade or level of repairing has been decided by the subjective estimation of the patients and doctors. So, we suggest the new standard for estimating the level of repair in this disease using nuclear medicine. Objective : To evalute the difference of the blood pool and delayed images in the correlation with clinical symptoms in patients with arthritis of knee joint by using acupuncture. Methods : Eight patients with arthritis of knee joint included in this study. Using Thermograph (D.I.T.I) and Radionuclide, we obtained the results. In Bone scan Tc-99m MDP, and MIBI scan was obtained at 1 minute and 3 hour after injection of 1,110 MBq Tc-99m MDP and MIBI. The analysis was carried out hurted area of joint. The Joint-to-background(J/B) ratios were obtained exclusively in the joints regions. Clinical symptoms were evaluated as pain and swelling graded from 0(no) to 5(severe) in the same joints, respectively. Results : J/B ratios on the delayed scans were higher than those on blood pool images. There was significant correlation between clinical symptoms and J/B on blood pool image in the joints =0.03). Conclusion : The results demonstrate that blood pool images of Tc-99m MDP scintigraphy correlates with clinical symptoms more than delayed images in patients with arthritis Joint.

  • PDF