You need Adobe Reader 7.0 or later in order to read PDF files on this site.
If Adobe Reader is not installed on your computer, click the button below and go to the download site.

Regular Articles

Vol. 13, No. 1, pp. 48–53, Jan. 2015. https://doi.org/10.53829/ntr201501ra1

Color-temperature Correspondence: Its Nature and Its Impact on Object Temperature Perception

Hsin-Ni Ho

Abstract

Color cues are often used to represent information concerning temperature, with red typically being associated with warm/hot, and blue with cold. Recent research from NTT Communication Science Laboratories demonstrated that such correspondences between color and temperature are not merely a design practice derived from a common sense belief. Instead, they have an actual impact on our information processing efficiency and object temperature perception. These findings are useful for the development of multimodal interfaces whose purpose is to provide a holistic experience in telecommunication and virtual environments.

Keywords: multisensory information processing, multimodal interface, temperature perception

1. Introduction

In developing multimodal interfaces aimed at providing a holistic experience in telecommunication and virtual reality environments, it is important to understand how our brains process and integrate multisensory information in order to achieve optimal performance. Color cues have been widely used to indicate information concerning temperature in the fields of industrial and interior design [1–4], and therefore, our current research on multisensory information processing focuses on such correspondences between color and temperature.

Correspondences between color and temperature have been studied by asking people to rate colored stimuli as being either warm or cold [2, 3, 5–7] or by instructing people to report which color they were reminded of when a thermal stimulus was presented to them [6]. As expected, people reported the color red being more often associated with warm, and blue with cold. This kind of association has been shown to affect people’s feelings of warmth and coldness, with reddish colors inducing warm feelings and bluish colors inducing cold feelings [3, 7–12]. The effects of color shown in those studies are presumably knowledge-based. That is, the effect may result from direct employment of the knowledge of red-warm/blue-cold association per se, since in those previous studies, only subjective measures were used, and in most of the experiments the warmth and coldness were only thought of, rather than being physically presented.

In our research on color-temperature correspondences, we investigated whether such correspondences could have an actual impact on people’s information processing efficiency and object temperature perception. The findings are expected to be useful in designing multimodal interfaces that aim to represent thermal information in virtual environments.

2. Impact of color-temperature correspondences on efficiency of information processing

We utilized two objective behavioral measures: the Implicit Association Test (IAT) and a priming task in order to examine what impact color-temperature correspondences have on information processing [13]. Both paradigms use reaction time (RT) as an objective task performance measure.

2.1 Simplified IAT

IAT is widely used in social psychology to assess the strength of an individual’s automatic associations between different concepts [14]. Here, we adapted a simplified version of IAT introduced by Parise and Spence [15] to examine the correspondences between color and temperature. In the experiment, a series of color patches and thermal words were presented on a display, one at a time. The participants’ task was to categorize thermal words (warm versus cold) or color patches (red versus blue) with two response keys. We manipulated the assignment of the color and temperature to each response key, as shown in Fig. 1(a). The foundation of the IAT is that it is easier to map two concepts into the same response key when they are internally associated (congruent) than when they are internally unrelated (incongruent). The participants consisted of 11 people (6 women), between the ages of 19 and 37; all had normal color vision.

We found that people’s responses were faster with congruent key assignments (red-warm, blue-cold) than with the incongruent key assignments (red-cold, blue-warm), regardless of whether the response target was a thermal word or a color patch (see Fig. 1(b)). Our results indicated that correspondences between color and temperature affect the speed of response to a color or thermal stimulus. Incongruent combinations may lead to a prolonging processing time.

Fig. 1. (a) Stimulus-response key assignment. (b) Results of the IAT. Congruent key assignments are represented by white bars and incongruent assignments by striped bars. The error bars show the standard errors of the means; the symbols * and ** respectively indicate the statistical significance of p<0.05 and p<0.01.

2.2 Priming task

We also used a priming task to investigate the interaction between color and temperature during information processing. In the experiment, color and thermal stimuli were presented sequentially in each trial, with the first stimulus acting as the task-irrelevant prime and the second stimulus as the target. When the prime consisted of a color stimulus, the target was a thermal stimulus, and vice versa. We manipulated the congruency of prime and target presented in each trial, so that half of the trials were congruent (e.g., red and warm) while the others were incongruent (e.g., red and cold). The color stimuli used were color patches, and the thermal stimuli used were words such as warm or cold that indicate thermal conditions, or physical warmth or coldness applied to the skin of the participant’s index finger. The participants consisted of 31 people (23 women), between the ages of 19 and 61; all had normal color vision. They were instructed to discriminate the color target (i.e., red or blue) or the thermal target (i.e., warm or cold) as rapidly as possible. Our purpose was to assess the influence of a prime stimulus on the perception of the target stimulus under different color-temperature combinations.

We found that exposure to a thermal stimulus had no effect on the RTs to discriminate the color of a stimulus (Figs. 2(b) and 2(d)), regardless of whether the thermal stimulus was semantic or physical, but exposure to a color stimulus did affect the RTs required to discriminate a physical temperature (Fig. 2(c)). This asymmetrical effect suggested that the color-temperature association might be stronger in the direction of color to temperature than temperature to color. This is not unexpected given that colors are often used to indicate temperature, but temperature is seldom used to indicate color. It was also found that when the target was a thermal word, there was no effect (Fig. 2(a)). However, when the target was a physical temperature, the RTs were significantly faster with a congruent prime (Fig. 2(c)).

Fig. 2. RTs for participants discriminating (a) thermal words and (b) color stimuli when the prime is a thermal word, and (c) physical temperature and (d) color stimuli when the prime is a physical temperature. Congruent and incongruent combinations are shown in white and striped bars, respectively. Error bars indicate the standard errors of the means, and * indicates statistical significance of p<0.05.

While IAT indicated that the correspondences between color and temperature have similar effects on the speed of response to a color or a thermal stimulus, a priming task showed that the correspondences are more effective in reducing the RTs for physical thermal stimuli than for color stimuli. This difference in the results presumably comes from the difference between these two paradigms. In IAT, a single stimulus is presented in each trial, and this design ensures that the effects result from the difference in the color-temperature congruency between the two stimulus-response key assignments (See Fig. 1(a)), rather than the stimulus per se. Therefore, similar effects were obtained for a color and a thermal stimulus as long as the color and temperature were associated. In contrast, in the priming task, two stimuli are presented in a single trial, and this design allows for the possible interaction between the color and thermal stimuli during information processing. Thus, the effect of color-temperature correspondences would be more effective for a target stimulus that requires a relatively long processing time such as a physical temperature (RT of ~2000 ms, see Fig. 2(c)). This is because a congruent color prime may facilitate people’s classifying/labeling a physical temperature to the response categories warm and cold and therefore reduce the RTs. In the case of a color target, the facilitation would be limited because its RTs are already short in the first place (500–600 ms; see Figs. 2(b) and 2(d)).

In summary, our findings from both tasks demonstrated that the correspondences between color and temperature have an effect on information processing efficiency. These findings are useful for the design of multimodal interfaces that intend to convey information with both visual (color) and thermal feedback.

3. Impact of color-temperature correspondences on object temperature perception

While our research introduced in section 2 confirmed that correspondences between color and temperature have an actual impact on information processing efficiency, it remains unclear whether such correspondences can influence temperature perception. Although previous studies have shown that color-temperature correspondences can affect people’s feelings of warmth and coldness, in most of these studies the temperature information was presented to the participants in an indirect, non-contact fashion [3, 7–12]. Because the most intuitive and natural way for people to obtain temperature information is to directly touch the object of interest, our purpose was to understand whether colors can still exert an influence under this circumstance. Although an old study reported some effects of color on object temperature judgments (e.g., green objects were more likely to be judged as warm than purple objects) [16], it remains unclear whether and how the effect is associated with the prevailing color-temperature correspondences.

When a hand touches an object, the feelings of warmth or coldness depend on not only the object temperature but also the hand temperature [17]. Accordingly, we studied the effect of color on object temperature perception by manipulating either the object color or the hand color while participants touched an object (Fig. 3(a)). We developed a novel multimodal system that utilizes a thermal display and advanced projection technology (Fig. 3(b)). This system can project colors onto the hand region selectively when the hand touches the object surface, and it can also control the temperature of the object surface. We varied the temperature of the object surface and asked the participants to judge whether or not the object felt warm [18]. Our purpose was to see whether object and hand colors have an influence on the lowest temperature required for the object to feel warm.

Fig. 3. (a) We manipulated object colors by attaching blue or red paper to the thermal display and hand colors by projecting blue or red light onto the hand. (b) The novel multimodal system developed for this study can perform feedback control to the surface temperature of the thermal display and selectively project colors onto the hand that was in contact with the thermal display.

What we found is that colors can affect our perception of object temperature, but not in the way that people would expect. Our data indicated that a red object, relative to a blue object, raises the lowest temperature required for an object to feel warm by 0.5°C (see Fig. 4(a)). In other words, our results indicated that a blue object is more likely to be judged as warm than a red object of the same physical temperature, which goes against the general expectation from the red-warm/blue-cold association. When the hand was colored red or blue, a reverse effect was found. This time, the lowest warm temperature for a red hand was lower than that for a blue hand by about 0.5°C (see Fig. 4(b)), indicating that red hands made objects feel warmer. Although the effect of colors here might seem small at first glance, our hands are able to detect temperature changes as small as 0.2°C and to distinguish temperatures that differ by as little as 0.03–0.09°C [19, 20]; thus, a change of 0.5°C is in fact relatively large and clearly perceptible.

Fig. 4. (a) A red object, relative to a blue object, raises the lowest temperature required for an object to feel warm, so that a blue object is more likely to be judged as warm than a red object of the same physical temperature. (b) The lowest warm temperature for a red hand was lower than that for a blue hand, so that with a red hand, participants tended to judge the touched object as being warmer than they did with a blue hand.

It is known that the brain integrates visual and tactile information when estimating the properties of an object explored by the hand [21]. For properties such as size or surface roughness, direct sensory inputs and expectations based on the visual information are averaged, so that the final perception is biased toward the expectations [21, 22]. In the case of estimating the temperature of an object, our data suggest that instead of taking the average of the expected and direct temperature inputs, our brain focuses on the difference between the two. As a result, the final perception is opposite to the expectation. Other object properties that have the same integration rule include weight, in which a larger object is tended to be judged as lighter than a smaller object of the same mass [23–27], and force, in which the perceived force from an impact on the palm is tended to be judged as weaker when the collision speed is fast compared to when the collision speed is slow [28].

In summary, our findings demonstrate that both object and hand colors can directly modulate temperature perception of an object touched by the hand and that the effect is opposite to the common red-warm/blue-cold expectation.

4. Applications to multimodal interface design

While current applications of color-temperature correspondences mainly focus on modulating people’s thermal experiences in different environmental conditions and providing information concerning temperature with color cues, our new findings that color-temperature correspondences have an impact on not only the efficiency of information processing but also object temperature perception provide new guidelines for multimodal interface design.

For applications involving visual and thermal feedback, as indicated in section 2, it is important to avoid presenting incongruent visual and temperature information, such as presenting the color red and a low temperature together, especially in situations where users need to respond to physical temperature information. This is because with incongruent combinations of color and temperature, the time required for users to process the information could be prolonged, and the performance of the interface would degrade. When the purpose of the interface is to create a holistic experience of interacting with an object in virtual environments or at a remote site, manipulating the object and hand colors with visual feedback can in fact modulate the perceived warmness or coldness during hand-object interactions, as indicated in section 3. For example, coloring a user’s hand red would make an object held in the hand feel warmer, and coloring a user’s hand blue would make the object feel cooler. It is important to note, however, that when manipulating the color of the object itself, the opposite effect is obtained. That is, when coloring an object red, it would give a cooler feeling instead of a warmer feeling. Because thermal feedback control is relatively complicated and requires special hardware, the effect of object and hand colors on temperature perception would allow a more energy-saving and lower cost multimodal interface.

5. Conclusion

Our findings on color-temperature correspondences not only provide fresh insights on how our brains process multisensory information, but they are also expected to contribute to the development of interfaces for providing multimodal information and holistic experiences in telecommunication and virtual environments.

References

[1]	M. Tinker, “Effect of Stimulus-texture upon Apparent Warmth and Affective Value of Colors,” The American Journal of Psychology, Vol. 51, pp. 532–535, 1938.
[2]	B. Wright, “The Influence of Hue, Lightness, and Saturation on Apparent Warmth and Weight,” The American Journal of Psychology, Vol. 75, No. 2, pp. 232–241, 1962.
[3]	P. C. Berry, “Effect of Colored Illumination upon Perceived Temperature,” Journal of Applied Psychology, Vol. 45, No. 4, pp. 248–250, 1961.
[4]	A. Fenko, H. N. J. Schifferstein, P. Hekkert, “Looking Hot or Feeling Hot: What Determines the Product Experience of Warmth?”, Materials and Design, Vol. 31, No. 3, pp.1325–1331, 2010.
[5]	C. L. Hardin, “Red and Yellow, Green and Blue, Warm and Cool: Explaining Color Appearance,” Journal of Consciousness Studies, Vol. 7, No. 8–9, pp. 113–122, 2000.
[6]	G. A. Morgan, F. E. Goodson, and T. Jones, “Age Differences in the Associations Between Felt Temperatures and Color Choices,” The American Journal of Psychology, Vol. 88, No. 1, pp. 125–130, 1975.
[7]	G. A. Michael and P. Rolhion, “Cool Colors: Color-induced Nasal Thermal Sensations,” Neuroscience Letters, Vol. 436, No. 2, pp. 141–144, 2008.
[8]	N. Matsubara, A. Gassho, and Y. Kurazumi, “Facilitatory Effects of Environmental Sounds on Hue-heat Phenomena,” Proc. of the 18th International Congress on Acoustics, pp. II-1775–1778, Kyoto, Japan, 2004.
[9]	J. Winzen, F. Albers, and C. Marggraf-Micheel, “The Influence of Coloured Light in the Aircraft Cabin on Passenger Thermal Comfort,” Lighting Research and Technology, 2013.
[10]	P. O. Fanger, N. O. Breum, and E. Jerking, “Can Colour and Noise Influence Man’s Thermal Comfort,” Ergonomics, Vol. 20, No. 1, pp. 11–18, 1977.
[11]	F. H. Durgin, L. Evans, N. Dunphy, S. Klostermann, and K. Simmons, “Rubber Hands Feel the Touch of Light,” Psychological Science, Vol. 18, No. 2, pp. 152–157, 2007.
[12]	G. A. Michael, H. Galich, S. Relland, and S. Prud’hon, “Hot Colors: The Nature and Specificity of Color-induced Nasal Thermal Sensations,” Behavioural Brain Research, Vol. 207, No. 2, pp. 418–428, 2010.
[13]	H.-N. Ho, G. H. Van Doorn, T. Kawabe, J. Watanabe, and C. Spence, “Colour-Temperature Correspondences: When Reactions to Thermal Stimuli Are Influenced by Colour,” PLoS ONE, Vol. 9, No. 3, 2014.
[14]	A. G. Greenwald, D. E. McGhee, and J. L. Schwartz, “Measuring Individual Differences in Implicit Cognition: The Implicit Association Test,” Journal of Personality and Social Psychology, Vol. 74, No. 6, pp. 1464–1480, 1998.
[15]	C. V. Parise and C. Spence, “Audiovisual Crossmodal Correspondences and Sound Symbolism: A Study Using the Implicit Association Test,” Experimental Brain Research,” Vol. 220, No. 3–4, pp. 319–333, 2012.
[16]	M. F. Mogensen and H. B. English, “The Apparent Warmth of Colors,” The American Journal of Psychology, Vol. 37, pp. 427–428, 1926.
[17]	H.-N. Ho and L. A. Jones, “Contribution of Thermal Cues to Material Discrimination and Localization,” Perception & Psychophysics, Vol. 68, pp. 118–128, 2006.
[18]	H.-N. Ho, D. Iwai, Y. Yoshikawa, J. Watanabe, and S. Nishida, “Combining Colour and Temperature: A Blue Object is More Likely to Be Judged as Warm Than a Red Object,” Scientific Reports, Vol. 4, 2014.
[19]	J. C. Stevens and K. K. Choo, “Temperature Sensitivity of the Body Surface over the Life Span,” Somatosensory & Motor Research, Vol. 15, No. 1, pp. 13–28, 1998.
[20]	K. O. Johnson, I. Darian-Smith, C. LaMotte, B. Johnson, and S. Oldfield, “Coding of Incremental Changes in Skin Temperature by a Population of Warm Fibers in the Monkey: Correlation with Intensity Discrimination in Man,” Journal of Neurophysiology, Vol. 42, No. 4, pp. 1332–1353, 1979.
[21]	M. O. Ernst and M. S. Banks, “Humans Integrate Visual and Haptic Information in a Statistically Optimal Fashion,” Nature, Vol. 415, pp. 429–433, 2002.
[22]	S. J. Lederman, G. Thorne, and B. Jones, “Perception of Texture by Vision and Touch: Multidimensionality and Intersensory Integration,” Journal of Experimental Psychology: Human Perception and Performance, Vol. 12, pp. 169–180, 1986.
[23]	M. O. Ernst, “Perceptual Learning: Inverting the Size-weight Illusion,” Current Biology, Vol. 19, No. 1, pp. 23–25, 2009.
[24]	J. B. Brayanov and M. A. Smith, “Bayesian and ‘Anti-Bayesian’ Biases in Sensory Integration for Action and Perception in the Size-weight Illusion,” Journal of Neurophysiology, Vol. 103, No. 3, pp. 1518–1531, 2010.
[25]	L. A. Jones, “Perception of Force and Weight: Theory and Research,” Psychological Bulletin, Vol. 100, No. 3, pp. 29–42, 1986.
[26]	H. E. Ross, “When Is a Weight Not Illusory?”, Quarterly Journal of Experimental Psychology, Vol. 21, No. 4, pp. 346–355, 1969.
[27]	A. Charpentier, “Analyse Expérimentale de Quelques Éléments de la Sensation de Poids [Experimental Study of Some Aspects of Weight Perception],” Archives de Physiologie Normale et Pathologique, Vol. 3., pp. 122–135, 1891.
[28]	K. Arai and K. Okajima, “Tactile Force Perception Depends on the Visual Speed of the Collision Object,” Journal of Vision, Vol. 9, No. 11, pp. 1–9, 2009.

Hsin-Ni Ho: Research Scientist, Sensory Representation Research Group, Human and Information Science Laboratory, NTT Communication Science Laboratories.
She received the Ph.D. in mechanical engineering from the Massachusetts Institute of Technology, USA, in 2006. She joined NTT Communication Science Laboratories as a Research Associate in 2007 and became a Research Scientist in 2010. Her research interests include haptic perception, multisensory interactions, material perception, and development of haptic interfaces. She is a member of the Haptics Committee in the Society of Instrument and Control Engineers, Japan, the Virtual Reality Society of Japan, the Society for Neuroscience, the Japan Neuroscience Society, and the Japanese Psychonomic Society.

↑ TOP