The sensory cultural heritage creates identity and cohesion in a community. The Multimodal Hong Kong (MMHK) started in January 2023 and aims to build a database of soundscape and smellscape at culturally significant sites. This paper will introduce the project and its objectives, present results from a pilot survey, and describe the development of a field work methodology. Data collection methods include Ambisonics audio, 360 ̊ video, and 'smellprints', together with on-site observations based on the Soundscape Indices survey protocol and the Dravnieks-McGinley-Zarzo 'smell atlas'. Currently having data from 20 sites, MMHK aims to reach 100 within the project's duration, as well as conduct outreach such as sensory walks, interviews, and workshops with stakeholders. The overall goal is to produce in-depth knowledge of how information, via multiple sensory modalities, constitute the perceived quality of places, and thence, how an intangible cultural heritage emerges in Hong Kong. This knowledge will enable future research and applications in urban spatial design, experiencescape, and virtual tourism.