• Title/Summary/Keyword: balance of exploration and exploitation

Search Result 23, Processing Time 0.028 seconds

Learning Less Random to Learn Better in Deep Reinforcement Learning with Noisy Parameters

  • Kim, Chayoung
    • Journal of Advanced Information Technology and Convergence
    • /
    • v.9 no.1
    • /
    • pp.127-134
    • /
    • 2019
  • In terms of deep Reinforcement Learning (RL), exploration can be worked stochastically in the action of a state space. On the other hands, exploitation can be done the proportion of well generalization behaviors. The balance of exploration and exploitation is extremely important for better results. The randomly selected action with ε-greedy for exploration has been regarded as a de facto method. There is an alternative method to add noise parameters into a neural network for richer exploration. However, it is not easy to predict or detect over-fitting with the stochastically exploration in the perturbed neural network. Moreover, the well-trained agents in RL do not necessarily prevent or detect over-fitting in the neural network. Therefore, we suggest a novel design of a deep RL by the balance of the exploration with drop-out to reduce over-fitting in the perturbed neural networks.

The Strategic Ambidexterity of Online Game Companies: The Exploitation and Exploration of NCsoft (온라인 게임회사의 전략적 양면성: 엔씨소프트의 활용과 탐험)

  • Bae, Joonheui;Koo, Dong Mo
    • Journal of Korea Game Society
    • /
    • v.15 no.1
    • /
    • pp.115-124
    • /
    • 2015
  • This research analyzed the case of Ncsoft to study the organizational learning, exploitation and exploration that create dynamic capability in hypercompetitive environment. First of all, we demonstrated the activities of exploitation and exploration in Ncsoft according to the life cycle of online game industry. An exploitation related to routine, learning and fit with existing environment brings about incremental innovation. In contrast, an exploration associated with non-learning, flexibility with changing environment results in radical innovation. We examined them based on the life cycle of its various game services. NCsoft that built the leading position in online game industry focused the exploitation activities at the stage of beginning period and growth, whereas NCsoft has increased the activities of exploration at period of mature. In addition, the firm conducts an exploration for its brand new game services and R&D. Conversely, An exploitation is conducted for sustainable updating of patch service and marketing and system building. The result implies that online game companies create sustainable competitive advantage using the balance between exploitation and exploration.

The Effects of Ambidextrous Alliance on Firm Performance (양손잡이 제휴(Ambidextrous Alliance)가 기업 성과에 미치는 영향)

  • Chung, Do-Bum;Kwak, Joo-Young
    • Journal of Technology Innovation
    • /
    • v.20 no.1
    • /
    • pp.17-43
    • /
    • 2012
  • Alliance formation has been recognized as an important strategy for firms who seek to survive through acquisition of sustainable competitive advantages. Specifically in high-tech industries, firms may consider formation of strategic alliances in order to access valuable external knowledge. These firms tend to be situated in a dilemma that they should choose between exploration and exploitation, which are two types of strategic choices suggested by March (1991). Working out the dilemma has been extensively discussed in the area of strategy or organization learning. Recently, however, an increasing number of studies have stressed on a balance between exploration and exploitation. Regarded as 'ambidextrous organizations' (Lavie and Rosenkopf, 2006), these firms that simultaneously pursue exploration and exploitation have emerged in high-tech industries, and many studies have provided evidence of positive association between organizational ambidexterity and firm performance. In the strategic alliance research, accordingly, scholars began to pay attention to the balanced choice between exploration-and exploitation-oriented alliances. Given these backgrounds, this study examines the relationship between alliance ambidexterity and firm performance. While previous research approached alliance ambidexterity mainly from the number of alliances, our study suggests ambidexterity in terms of alliance portfolio and alliance partner. Our dataset consists of biotechnology or pharmaceutical firms in the United States, which spans time period between 1990 and 2005. We conduct panel data analysis. The results show the strong link between alliance ambidexterity and firm performance, highlighting the balance between exploration and exploitation when firms make strategic decisions.

  • PDF

A Study on the Convergence of Optimal Value using Selection Method in Genetic Algorithms (유전자 알고리즘에서 선택 기법을 이용한 해의 수렴 과정에 관한 연구)

  • 김용범;김병재;박명규
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.20 no.42
    • /
    • pp.171-179
    • /
    • 1997
  • Genetic Algorithms face an inherent conflict between exploitation and exploration. Exploitation refers to taking advantage of information already obtained in the search. Exploration show that a pattern in bits coupled with another pattern elsewhere in the string is more effective. In this paper shows that the selection method has a major impact on the balance between exploitation and exploration. A more heavy-handed approach seeks to exploit the available information. If decisions must be made quickly, especially those in real-time trading environments, then quicker convergence through exploitation may be more desirable. Also this paper we present some theoretical and empirical the selection method in genetic algorithms for a GA-hard problem.

  • PDF

The Study on the Balance of Ambidextrous Strategy of Exploration and Exploitation for Startup Performance (조직의 탐색과 활용에 대한 양손잡이 전략의 균형이 스타트업 성과에 미치는 영향)

  • Choi, Sung Chul;Lee, Woo Jin
    • Asia-Pacific Journal of Business Venturing and Entrepreneurship
    • /
    • v.16 no.6
    • /
    • pp.131-144
    • /
    • 2021
  • The organizational ambidexterity is an organizational strategy designed to pursue exploration activities to seize new opportunities and exploitation activities to efficiently use resources. Most of these ambidextrous structures have been studied for large corporations with slack resources, and there are still not many studies on the necessity of an ambidextrous structure for startups with relatively low-level resources. However, recently, the startup ecosystem is being advanced globally, and the amount of VC investment is rapidly increasing. This is a time when a lot of venture fund is invested in startups and a startup-friendly environment for rapid growth is created. This is the time to discuss the necessity and applicability of an ambidextrous organizational structure for startups. Therefore, this study conducted a hypothesis test whether the importance and necessity of balance that startups solving market problems with new ideas and utilizing accumulated resources have. To conduct this study, we analyzed 140 startups data gathered from the survey and the moderation effect was also analyzed. As a result of the study, it was verified that the balance of startup exploration and exploitation had a significant effect on startup performance, and the moderating effect of environmental dynamics was found to have a significant effect on the relationship with non-financial performance. Therefore, for startups with insufficient resources, it was concluded that the surplus resources generated in the process of a firm's growth should be effectively utilized and the balance between exploration and exploitation should be balanced from the initial stage of searching for a new business. In other words, it was confirmed that it is important for continuous growth and survival to seek the structure of an ambidextrous organization in order to internalize a mechanism that enables startups to pursue both effectiveness and efficiency in the long term. This study suggests a strategic direction for the growth of startups from the perspective of organizational structure. We expect that this meaningful results on the relationship between the ambidextrous capabilities of startups and performance contribute to the growth of startups in the rapidly growing startup venture environment.

Balancing the Tradeoffs Between Exploration and Exploitation (탐색 (Exploration)과 이용(Exploitation)의 상반관계의 균형에 관한 연구)

  • Park, Sun-Ju
    • Journal of KIISE:Software and Applications
    • /
    • v.32 no.11
    • /
    • pp.1099-1110
    • /
    • 2005
  • As auctions become popular, developing good agent bidding strategies has been an important focus in agent-based electronic commerce research. Especially for the continuous double auctions where no single dominant strategy is known, the agent bidding strategy has practical significance. This paper introduces an adaptive agent strategy for the countinuous double auction. The central idea is to let the agent figure out at run time when the sophisticated strategy (called the p-strategy) is beneficial and when a simpler strategy is better. Balance between exploration and exploitation is achieved by using a heuristic exploration function that trades off the expected profits and the number of tries of each strategy. We have experimentally evaluated the performance of the adaptive strategy in a wide variety of environments. The experiment results indicate that the adaptive strategy outperforms the plain p-strategy when the p-strategy performs poorly, while it performs similar to the p-strategy when the p-strategy dominates the other simple strategies.

Working Mechanisms of Organizational Ambidexterity for Creative Performance (창의적 성과를 제고하는 조직 양면성 구현양식에 대한 연구)

  • Kwon, Jung-Eon;Woo, Hyung-Rok
    • Knowledge Management Research
    • /
    • v.17 no.2
    • /
    • pp.51-73
    • /
    • 2016
  • The organizational ambidexterity has been emerging as the way to gain competitive advantage in turbulent environment. The concept of ambidexterity is simultaneously accomplishing the balance between the activities of exploration and exploitation, and overcoming their conflicting tension. The beneficial merits of ambidexterity has been investigated in innovation, financial performance, strategic management, and etc. Our study focused on the impact of ambidextrous activities on creative performance. Although three ambidextrous modes-structural ambidexterity, contextual ambidexterity, and sequential ambidexterity-have been already acknowledged, scant studies suggested the specific mechanisms to achieve ambidexterity in practice at the operating level. To address the issue we performed the semantic network analysis on the basis of the previous literatures prescribing ambidexterity theory. We took interview with 21 teams to explore behaviors of teams from the ambidextrous perspective, and then interpreted the relationship among words which appeared in the interview. This study found the appropriate mechanism which alleviate tension revealed by exploitation and exploration exist as practical reality. We demonstrated how these ambidextrous mechanisms can be used to generate the creative performance as well as examined various antecedents. These findings would contribute to the more fine-grained understanding of organizational ambidexterity, especially in conjunction with organizational creativity.

Effects of Platform-based Exploratory and Exploitative Technology Strategy on Firm's Performance: Nanotechnology case (탐험과 활용관점 플랫폼 기술 포트폴리오 전략이 성과에 미치는 영향: 나노기술을 중심으로)

  • Moon, Hee-Sung;Shin, Juneseuk
    • Journal of Technology Innovation
    • /
    • v.27 no.1
    • /
    • pp.45-77
    • /
    • 2019
  • The balance between exploration for new possibility and exploitation for existing certainty is an important issue in strategy, innovation, R&D as well as organization learning. Among the convergence trends of technologies, many firms seek to have the wider technological knowledge assets and the deeper technology capabilities for the sustainable competitive advantage at the same time. While firms plan technology portfolio strategies, they should consider the attribute of the technology. Nanotechnology, a cutting-edge technology, is a general purpose technology, unlike conventional product-oriented technologies. This empirical study was focused on how multi-national firms' exploration and exploitation strategies for nanotechnology affect their innovative and financial performance. It uses multiple regression analysis on panel data. This result shows that the more diversified and specialized nanotechnology as platform technology is positively related to their innovative and financial performance, unlike the research results for product-oriented technologies. In addition, exploratory innovation is more effective to firm performance than exploitation. This implies how global firms can manage effectively platform technology strategies under the constraints of resources.

Hybrid artificial bee colony-grey wolf algorithm for multi-objective engine optimization of converted plug-in hybrid electric vehicle

  • Gujarathi, Pritam K.;Shah, Varsha A.;Lokhande, Makarand M.
    • Advances in Energy Research
    • /
    • v.7 no.1
    • /
    • pp.35-52
    • /
    • 2020
  • The paper proposes a hybrid approach of artificial bee colony (ABC) and grey wolf optimizer (GWO) algorithm for multi-objective and multidimensional engine optimization of a converted plug-in hybrid electric vehicle. The proposed strategy is used to optimize all emissions along with brake specific fuel consumption (FC) for converted parallel operated diesel plug-in hybrid electric vehicle (PHEV). All emissions particulate matter (PM), nitrogen oxide (NOx), carbon monoxide (CO) and hydrocarbon (HC) are considered as optimization parameters with weighted factors. 70 hp engine data of NOx, PM, HC, CO and FC obtained from Oak Ridge National Laboratory is used for the study. The algorithm is initialized with feasible solutions followed by the employee bee phase of artificial bee colony algorithm to provide exploitation. Onlooker and scout bee phase is replaced by GWO algorithm to provide exploration. MATLAB program is used for simulation. Hybrid ABC-GWO algorithm developed is tested extensively for various values of speeds and torque. The optimization performance and its environmental impact are discussed in detail. The optimization results obtained are verified by real data engine maps. It is also compared with modified ABC and GWO algorithm for checking the effectiveness of proposed algorithm. Hybrid ABC-GWO offers combine benefits of ABC and GWO by reducing computational load and complexity with less computation time providing a balance of exploitation and exploration and passes repeatability towards use for real-time optimization.

The Empirical Study on the Relationship between Innovation Type and Network Configuration of IT SMEs (중소 IT기업의 혁신유형별 네트워크 형태에 대한 실증 연구)

  • Kim, Sun-Woo;Lee, Jang-Jae;Lee, Chul-Woo
    • Journal of the Korean association of regional geographers
    • /
    • v.12 no.6
    • /
    • pp.693-703
    • /
    • 2006
  • Keeping the balance between exploration of new possibilities and exploitation of existing certainties in organizational innovation is getting its significance as business environments become more turbulent This paper focused on the relationship between two different types of innovation and network configuration. For this purpose, we conducted the empirical studies of 168 IT SMEs located in Gyeongbuk. For this analysis, we defined two innovation types as exploratory innovation and exploitative innovation. Also, we considered network scope and strength of tie as network configuration. The results showed that the exploratory innovation had sparse network of network scope and weak tie of strength. On the contrary the exploitative innovation had dense network and strong tie.

  • PDF