• Title/Summary/Keyword: cross-modal

Search Result 143, Processing Time 0.034 seconds

Cross modal Transfer in Infancy : Transfer from Touch to Vision (유아의 감각양식간 전이 - 촉각에서 시각으로의 전이 -)

  • Hong, Hee Young
    • Korean Journal of Child Studies
    • /
    • v.7 no.1
    • /
    • pp.67-84
    • /
    • 1986
  • The purpose of the present research was to investigate cross-modal transfer, especially tactual-to-visual transfer in infancy and to study the relation between failure of cross-modal transfer performance and length of familiarization period. The subjects of this study were 60 infants, 10 boys and 10 girls at each level: six, nine, and twelve months of age. All were normal, healthy, full-term babies. The mothers' educational achievement was controlled at more than 12 years of schooling. There were two separate experimental conditions, one 30-sec and one 60-sec familiarization period. Each experimental condition consisted of a tactual familiarization and a visual recognition memory test. Each child was presented with these 2 sets of cross-modal stimuli in one of the 2 experimental conditions. Infants' visual responses in the visual recognition memory test were videotaped for 20 seconds. Visual fixation time to novel and familiar stimuli was observed throughout the test. The data was analyzed with t-test, percentage of total fixation time to novel stimuli, and ANOVA. The results showed that: 1) Significant differences were found in the cross-modal transfer performance from touch to vision between the 3 age groups. This is, 6 and 9 month old infants didn't show cross-modal transfer in the 30-sec condition, but 12 month old infants did show cross-modal transfer in the 30-second. 2) In all 3 age groups, no significant differences were found in cross-modal transfer performance between the two conditions.

  • PDF

3D Cross-Modal Retrieval Using Noisy Center Loss and SimSiam for Small Batch Training

  • Yeon-Seung Choo;Boeun Kim;Hyun-Sik Kim;Yong-Suk Park
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.18 no.3
    • /
    • pp.670-684
    • /
    • 2024
  • 3D Cross-Modal Retrieval (3DCMR) is a task that retrieves 3D objects regardless of modalities, such as images, meshes, and point clouds. One of the most prominent methods used for 3DCMR is the Cross-Modal Center Loss Function (CLF) which applies the conventional center loss strategy for 3D cross-modal search and retrieval. Since CLF is based on center loss, the center features in CLF are also susceptible to subtle changes in hyperparameters and external inferences. For instance, performance degradation is observed when the batch size is too small. Furthermore, the Mean Squared Error (MSE) used in CLF is unable to adapt to changes in batch size and is vulnerable to data variations that occur during actual inference due to the use of simple Euclidean distance between multi-modal features. To address the problems that arise from small batch training, we propose a Noisy Center Loss (NCL) method to estimate the optimal center features. In addition, we apply the simple Siamese representation learning method (SimSiam) during optimal center feature estimation to compare projected features, making the proposed method robust to changes in batch size and variations in data. As a result, the proposed approach demonstrates improved performance in ModelNet40 dataset compared to the conventional methods.

A cross-modal naming study: Effects of prosodic boundaries on the comprehension of relative clauses in Japanese

  • Kang, Soyoung;Kashiwagi, Akiko;Nakayama, Mineharu;Speer, Shari R.
    • Cross-Cultural Studies
    • /
    • v.24
    • /
    • pp.157-169
    • /
    • 2011
  • Compared to studies on prosodic effects on the comprehension of syntactic ambiguity in English, there are relatively few that investigated prosodic effects in East-Asian languages. This study examined the role of prosodic information in processing syntactically ambiguous sentences in Japanese. For syntactically ambiguous sentences containing relative clauses, this paper investigated whether prosodic information is immediately available during the process of these ambiguous sentences. Results from an auditory comprehension experiment with an on-line, cross-modal naming task seemingly suggest that contrary to the findings from the off-line study that examined the same constructions, prosodic information may not be immediately available to Japanese listeners. A possible account for failure to obtain effects of prosodic information is provided.

Estimation of semi-rigid joints by cross modal strain energy method

  • Wang, Shuqing;Zhang, Min;Liu, Fushun
    • Structural Engineering and Mechanics
    • /
    • v.47 no.6
    • /
    • pp.757-771
    • /
    • 2013
  • We present a semi-rigid connection estimation method by using cross modal strain energy method. While rigid or pinned assumptions are adopted for steel frames in traditional modeling via finite element method, the actual behavior of the connections is usually neither. Semi-rigid joints enable connections to be modeled as partially restrained, which improves the quality of the model. To identify the connection stiffness and update the FE model, a newly-developed cross modal strain energy (CMSE) method is extended to incorporate the connection stiffness estimation. Meanwhile, the relations between the correction coefficients for the CMSE method are derived, which enables less modal information to be used in the estimation procedure. To illustrate the capability of the proposed parameter estimation algorithm, a four-story frame structure is demonstrated in the numerical studies. Several cases, including Semi-rigid joint(s) on single connection and on multi-connections, without and with measurement noise, are investigated. Numerical results indicate that an excellent updating is achievable and the connection stiffness can be estimated by CMSE method.

Shape Optimization of Rotating Cantilever Beams Considering Their Varied Modal Characteristics

  • Cho, Jung-Eun;Yoo, Hong-Hee
    • Journal of Mechanical Science and Technology
    • /
    • v.18 no.2
    • /
    • pp.246-252
    • /
    • 2004
  • The modal characteristics of rotating structures vary with the rotating speed. The material and the geometric properties of the structures as well as the rotating speed influence the variations of their modal characteristics. Very often, the modal characteristics of rotating structures need to be specified at some rotating speeds to meet their design requirements. In this paper, rotating cantilever beam is chosen as a design target structure. Optimization problems are formulated and solved to find the optimal shapes of rotating beams with rectangular cross section.

Incomplete Cholesky Decomposition based Kernel Cross Modal Factor Analysis for Audiovisual Continuous Dimensional Emotion Recognition

  • Li, Xia;Lu, Guanming;Yan, Jingjie;Li, Haibo;Zhang, Zhengyan;Sun, Ning;Xie, Shipeng
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.13 no.2
    • /
    • pp.810-831
    • /
    • 2019
  • Recently, continuous dimensional emotion recognition from audiovisual clues has attracted increasing attention in both theory and in practice. The large amount of data involved in the recognition processing decreases the efficiency of most bimodal information fusion algorithms. A novel algorithm, namely the incomplete Cholesky decomposition based kernel cross factor analysis (ICDKCFA), is presented and employed for continuous dimensional audiovisual emotion recognition, in this paper. After the ICDKCFA feature transformation, two basic fusion strategies, namely feature-level fusion and decision-level fusion, are explored to combine the transformed visual and audio features for emotion recognition. Finally, extensive experiments are conducted to evaluate the ICDKCFA approach on the AVEC 2016 Multimodal Affect Recognition Sub-Challenge dataset. The experimental results show that the ICDKCFA method has a higher speed than the original kernel cross factor analysis with the comparable performance. Moreover, the ICDKCFA method achieves a better performance than other common information fusion methods, such as the Canonical correlation analysis, kernel canonical correlation analysis and cross-modal factor analysis based fusion methods.

Modal transformation tools in structural dynamics and wind engineering

  • Solari, Giovanni;Carassale, Luigi
    • Wind and Structures
    • /
    • v.3 no.4
    • /
    • pp.221-241
    • /
    • 2000
  • Structural dynamics usually applies modal transformation rules aimed at de-coupling and/or minimizing the equations of motion. Proper orthogonal decomposition provides mathematical and conceptual tools to define suitable transformed spaces where a multi-variate and/or multi-dimensional random process is represented as a linear combination of one-variate and one-dimensional uncorrelated processes. Double modal transformation is the joint application of modal analysis and proper orthogonal decomposition applied to the loading process. By adopting this method the structural response is expressed as a double series expansion in which structural and loading mode contributions are superimposed. The simultaneous use of the structural modal truncation, the loading modal truncation and the cross-modal orthogonality property leads to efficient solutions that take into account only a few structural and loading modes. In addition the physical mechanisms of the dynamic response are clarified and interpreted.

Cross-Modal Associations between Colors and Fragrances for Commercial Perfume Design (향수제품 디자인을 위한 색과 향의 교차-양상 연상관계)

  • Kim, Yu-Jin
    • Science of Emotion and Sensibility
    • /
    • v.11 no.3
    • /
    • pp.427-439
    • /
    • 2008
  • In order to effectively communicate the fragrances of commercial perfumes to consumers, it is important to apply congruent colors to their bottles and packaging. This research investigated the cross-modal associations between colors and fragrances through two experiments. In the first experiment, bottle colors of more than 200 popular perfumes in the market were analyzed. Distinguishable color design patterns of the bottles were revealed in accordance with their fragrance types. The second experiment expanded the use of color-odor matching task to a test population of Korean participants. Participants selected colors evoked by fragrances of three test perfumes in a blind setting. These three perfumes had characteristic hues and their associated hues were similar with the real colors of their bottles. In addition, there were significant variations in color tone across fragrance notes, viz. the top notes, middle notes, and base notes. The results of the two experiments suggest the existence of robust cross-modal associations between particular colors and fragrances in commercial perfumery.

  • PDF

An Analysis on the Fluid-Loading Coefficients of Cylindrical Shell Structure With Arbitrary end Conditions (임의 경계조건을 가진 원통셸 구조의 유체영향계수 해석)

  • 전재진;정우진
    • Journal of KSNVE
    • /
    • v.6 no.3
    • /
    • pp.297-303
    • /
    • 1996
  • The general approach using sine series expansions was represented to evaluate the radiation loading from a vibrating surface on a simply supported cylinder. In this paper, the fluid-loading coefficients (radiation impedance) for a submerged finite cylindrical shell with an arbitrary end condition are defined and evaluated. The vibrations of cylindrical shell are expressed by using cosine series expansions to analyze the radiation impedance for a finite cylindrical shell. It is possible to represent the displacements at both ends of cylindrical shell in comparison with sine series. The direct and cross modal components of fluid-loading coefficients are shown and the validity of cosine series expansions are verified from the results of numerical computations. This approach and results are directly applicable in the analysis of sound radiation from subemerged finite cylindrical shell with arbitrary end conditions.

  • PDF