• The Journal of Korea Robotics Society
• /
• v.17 no.3
• /
• pp.264-272
• /
• 2022

Human-robot cooperative tasks are increasingly required in our daily life with the development of robotics and artificial intelligence technology. Interactive reinforcement learning strategies suggest that robots learn task by receiving feedback from an experienced human trainer during a training process. However, most of the previous studies on Interactive reinforcement learning have required an extra feedback input device such as a mouse or keyboard in addition to robot itself, and the scenario where a robot can interactively learn a task with human have been also limited to virtual environment. To solve these limitations, this paper studies training strategies of robot that learn table balancing tasks interactively using deep reinforcement learning with human's facial expression feedback. In the proposed system, the robot learns a cooperative table balancing task using Deep Q-Network (DQN), which is a deep reinforcement learning technique, with human facial emotion expression feedback. As a result of the experiment, the proposed system achieved a high optimal policy convergence rate of up to 83.3% in training and successful assumption rate of up to 91.6% in testing, showing improved performance compared to the model without human facial expression feedback.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.17 no.7
• /
• pp.1951-1975
• /
• 2023

Recent advances in Cognitive Radio Networks (CRN) have elevated them to the status of a critical instrument for overcoming spectrum limits and achieving severe future wireless communication requirements. Collaborative spectrum sensing is presented for efficient channel selection because spectrum sensing is an essential part of CRNs. This study presents an innovative cooperative spectrum sensing (CSS) model that is built on the Firefly Algorithm (FA), as well as machine learning artificial neural networks (ANN). This system makes use of user grouping strategies to improve detection performance dramatically while lowering collaboration costs. Cooperative sensing wasn't used until after cognitive radio users had been correctly identified using energy data samples and an ANN model. Cooperative sensing strategies produce a user base that is either secure, requires less effort, or is faultless. The suggested method's purpose is to choose the best transmission channel. Clustering is utilized by the suggested ANN-FA model to reduce spectrum sensing inaccuracy. The transmission channel that has the highest weight is chosen by employing the method that has been provided for computing channel weight. The proposed ANN-FA model computes channel weight based on three sets of input parameters: PU utilization, CR count, and channel capacity. Using an improved evolutionary algorithm, the key principles of the ANN-FA scheme are optimized to boost the overall efficiency of the CRN channel selection technique. This study proposes the Artificial Neural Network with Firefly Algorithm (ANN-FA) for cognitive radio networks to overcome the obstacles. This proposed work focuses primarily on sensing the optimal secondary user channel and reducing the spectrum handoff delay in wireless networks. Several benchmark functions are utilized We analyze the efficacy of this innovative strategy by evaluating its performance. The performance of ANN-FA is 22.72 percent more robust and effective than that of the other metaheuristic algorithm, according to experimental findings. The proposed ANN-FA model is simulated using the NS2 simulator, The results are evaluated in terms of average interference ratio, spectrum opportunity utilization, three metrics are measured: packet delivery ratio (PDR), end-to-end delay, and end-to-average throughput for a variety of different CRs found in the network.

• Journal of Aerospace System Engineering
• /
• v.18 no.2
• /
• pp.1-11
• /
• 2024

This paper applies a relative impact angle control guidance law to a communication-based multi-missile network system with uncertainties and disturbances. The multi-missile network system is represented as a transitive reduction directed acyclic graph. Furthermore, this paper introduces both centralized and decentralized guidance laws based on the graph's structure. The relationship between these guidance laws is analyzed by comparing them based on the communication structure and the presence of system noise. To analyze the effects of decentralized optimal cooperative guidance law, this paper assumes uncertainty in missile dynamics and predicted impact point information for the relative impact angle control mission. Monte Carlo simulations are conducted for various mission environments to analyze the impact of communication and its structure on the system.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.34 no.10A
• /
• pp.752-759
• /
• 2009

Cooperative diversity is an effective technique to combat multi-path fading. When this technique is applied to energy-constrained wireless sensor networks, it is a key issue to design appropriate relay selection and power allocation strategies. In this paper, we proposed a new multi-relay selection and power allocation algorithm to maximize network lifetime. The algorithm are composed of two relay selection stages, where the channel condition and residual power of each node were considered in multi-relay selection and the power is fairly allocated proportional to the residual power, satisfies the required SNR at destination and minimizes the total transmit power. In this paper, proposed algorithm is based on AF (amplify and forward) model. We evaluated the proposed algorithm by using extensive simulation and simulation results show that proposed algorithm obtains much longer network lifetime than the conventional algorithm.

• Korean Management Science Review
• /
• v.26 no.3
• /
• pp.23-35
• /
• 2009

This study deals with the location management in WCDMA (Wideband Code Division Multiple Access) networks. The new location management method is the one of the many techniques used to provide the packet switched (PS) services effectively in WCDMA networks. WCDMA introduces RA (routing area) for the PS services in addition to LA (location area) for the circuit switched (CS) services. WCDMA system also adopts the cooperative paging and the combined area update which are to decrease signaling traffic using the PS network resources for the CS services. Considering the characteristics of the WCDMA networks, this study formulate into the mathematical programming problem for the location management. Rather than the existing researches which consider the single MSC/SGSN networks, we deal with the multi MSC/SGSN networks, where both MSC area and SGSN area should be determined as well. Fairness between traffic loads of MSC/SGSN and the system cost incurred to MSC/SGSN are also incorporated into our model, which make the model more realistic. We propose greedy algorithms for the problems, which consists of the merger of two neighboring areas and the movement of an area. Extensive experiment has been done based on the realistic problem examples. Followed by the analysis of parameter effect on the final solutions and the quality of final solutions obtained by our greedy algorithms. Our proposed model and analysis result can be used to determine WCDMA system areas and to predict the system performance measures by the determination.

• International Journal of Computer Science & Network Security
• /
• v.24 no.2
• /
• pp.95-100
• /
• 2024

Cyclic Delay Diversity (CDD) is a diversity scheme used in OFDM-based telecommunication systems, transforming spatial diversity into frequency diversity and thus avoiding intersymbol interference without entailing the receiver to be aware of the transmission strategy making the signal more reliable achieving full diversity gain in cooperative systems. Here the analyzation of the influence of CDD-SC scheme in Cognitive Radio Network (CRN) is done with the challenge of overcoming the complication called channel estimation along with overhead in CNR. More specifically, the closed-form expressions for outage probability and symbol error rate are divided under different frequencies among independent and identically distributed (i.i.d.) frequency selective fading channel model i.e., the signal is divided into different frequencies and transmitted among several narrow band channels of different characteristics. It is useful in the reduction of interference and crosstalk. The results reveal the diversity order of the proposed system to be mainly affected by the number of multipath components that are available in the CNR.

• Proceedings of the Korea Contents Association Conference
• /
• 2006.11a
• /
• pp.776-779
• /
• 2006

Today, It has developed actively e-learning according to web without time and place which increase of PC user with super-highway information network and various up-to-date information rapid growth. It has to provide the chance to student which will be able to practice and to think free and originative under liberal learning environment that learner can compose knowledge through various thinking by themselves. From the present paper, I would design e-learning system using TGT model of cooperative e-learning system that more effective studying through advantage of e-learning studying. I look forward to helping improvement of student's real ability as embody competitive games method by TGT model's basic theory of web-based.

• International conference on construction engineering and project management
• /
• 2020.12a
• /
• pp.381-386
• /
• 2020

Global construction and engineering consulting (E&C) firms are actively seeking entry into overseas markets based on loan projects from multilateral development banks to provide a basis for entry into overseas markets and sustainable growth. Bids on these projects are competitive between global top firms in terms of the technical level and price due to the limited number of projects; thus, developing a successful partnership to complement competence has become an essential element to win bids. In this regard, many studies have analyzed enterprises through characteristic analyses or the derivation of influential factors from the past social networks based on social network analysis (SNA). However, few studies have been conducted to reflect the process of changes to analyze collaborative relationships. Thus, this study aims to identify dynamic changes in past social networks and develop a model that can predict changes in the relationships between E&C firms based on similarities or differences between firms, presenting a methodology to target firms for appropriate collaboration. The analysis results demonstrate that the sensitivity of the developed prediction model was 70.26%, which could accurately predict 163 out of 232 actual cooperative cases.

• Journal of Korean Port Research
• /
• v.13 no.2
• /
• pp.289-302
• /
• 1999

As the size and complexity of network increase Distributed System Management (DSM) will be significant issue within information network in order to increase the high reliability and to improve the flexibility of network management. The OSI management model has several problems. The key problems are that it does not fully address the problem of how to develop communication protocol in support of DSM and how to classify the management connection criteria. In this paper to solve first problem described above this paper propose the connectionless CMIP to accomplish for effectively managing the distributed management managing systems to handle the dynamic informations. To work out second problem we introduce the connection criteria in the hierarchy of management system and finally evaluate the efficiency of a suggested protocol during cooperative negotiation among the managing system.

• Proceedings of the Korean Institute of Navigation and Port Research Conference
• /
• 1999.10a
• /
• pp.163-175
• /
• 1999

As the size and complexity of network increase, Distributed Systems Management (DSM) will be significant issue within information network in order to increase the high reliability and to improve the flexibility of network management. The OSI management model has several problems. The key problems are that it does not fully address the problems of how to develop communication protocol in support of DSM, and how to classify the management connection criteria. In this paper, to solve first problem described above, this paper propose the connectionless CMIP(Common Management Information Protocol) to accomplish for effectively managing the distributed management system, and indicate its efficiency; this protocol is available to negotiate among the managing systems, handle the dynamic information. To work out second problem, we introduce the connection criteria in the hierarchy of management systems, and finally evaluate the efficiency of a suggested protocol during cooperative negotiation among the managing systems.