Monthly Report #000
How Generative AI Answers About Kyoto Experiences (July 2026)
A baseline across 3 categories × 4 languages, 240 observations
1. Summary
For this report, we asked ChatGPT for recommendations on Kyoto "tea ceremony," "kimono," and "zen meditation" experiences, 20 times each across four languages, and logged the sources cited in each answer (12 cells in total, 240 observations).
The analysis found a consistent pattern in which sources get cited. This pattern appears to track two main factors.
One is whether the category has enough of a market to sustain comparison sites and affiliates. The other is whether such sources have actually been built out in that language, and are reachable by the AI.
In cells where both conditions hold, AI tended to cite comparison media. Where either was missing, the business's own official site tended to be cited instead. This report is a single-timepoint, single-engine cross-sectional observation, however, so this correspondence is a hypothesis consistent with the observed pattern, not a proven causal relationship.
Report #000 (this issue) establishes the observation method and evaluation metrics as a baseline. Starting from this issue as t=0, future monthly reports will track how this structure changes over time.
2. Method
We used ChatGPT (GPT-5.5, web version) in a temporary chat / logged-out state.
Base queries followed a "Kyoto + category term + recommendation term" pattern, observed in four languages: Japanese, English, Simplified Chinese, and Traditional Chinese. The three target categories were tea ceremony, kimono rental, and zen meditation.
Each query was run 20 times (n=20) consecutively, logging the business names and source domains cited in each answer, along with execution date/time, location (Kyoto City), network, and model name.
Cited sources were classified into six types: Public, Owned, OTA, Media, Directory, and UGC. Records were kept at the individual-outlet level; aggregation was done at the brand level.
We separately confirmed beforehand that keyword-style queries (e.g. "Kyoto tea ceremony recommended") and natural-language queries return no significant difference in the businesses returned. This study therefore used keyword-style queries throughout.
Raw data is published as data.csv (CC BY 4.0, free, not for sale).
Scope: This report covers only responses to recommendation-type queries. Comparison-type, transactional, and named-entity queries may draw on different sources.
This issue is also a single-timepoint observation (t=0); it does not discuss change or trends. Those will be analyzed using monthly data from Report #001 onward.
Further, this study is limited to ChatGPT (GPT-5.5), a single observer, and a single execution location. Results should not be generalized to other generative AI systems or different conditions without qualification.
The relationships described in Section 3 among category commerciality, language conditions, and self-description capability are a hypothesis-driven interpretation consistent with the observed pattern; they are not a proven causal claim.
We state this scope up front, consistent with the study's basic stance: draw conclusions from a meaningful number of observations, not from a single response (n=1).
3. Citation source distribution
3.1 Dominant source type across 12 cells (share, %)
| Japanese | English | Simplified Chinese | Traditional Chinese | |
|---|---|---|---|---|
| Tea ceremony | Public 52.2 | Media 46.0 (2nd: Owned 40.0, gap 6pt) | Owned 40.6 (2nd: Public 37.5, gap 3pt) | Owned 56.8 |
| Kimono | Media 53.7 | Media 49.1 + OTA 30.9 ≈ 80 | Owned 54.8 | Owned 66.7 |
| Zen | Public 50.0 + Directory 23.5 | Owned 80.2 | Owned 49.5 (2nd: Public 35.2, gap 14pt) | Owned 43.4 (2nd: Public 40.4, gap 3pt) |
(n=20 per cell. Classification criteria follow the methodology appendix. "2nd" shows the gap in points from the second-place type.)
Three patterns are visible in the table above.
First, the more commercial a category, the more likely comparison media are cited. In kimono, where comparison sites and affiliates are viable, comparison media dominate citations. In zen meditation, centered on free sessions, such sources are almost absent — public sites and providers' own official sites dominate instead.
Second, the sources AI can draw on differ by language. In the Japanese and English kimono markets, comparison media already exist in numbers, so AI cites them. Tea ceremony has few comparison media in any language, so government tourism sites and travel media dominate instead.
Third, where comparison media are scarce, official sites tend to be cited instead. This is especially pronounced in the Chinese-language cells and in zen meditation.
A pattern common to Chinese: across the six Simplified and Traditional Chinese cells, owned sites were cited most in every category. No Chinese-language cell had public sites or comparison media in first place.
The size of that lead varies by category, though. In kimono, both Simplified Chinese (owned 54.8% / public 17.8%) and Traditional Chinese (owned 66.7% / public 10.4%) show owned sites well ahead. In tea ceremony and zen, the gap narrows: tea ceremony (Simplified) and zen (Traditional) are both close, at roughly a 3-point gap, while zen (Simplified) shows a 14-point gap and tea ceremony (Traditional) a 32-point gap. A simple split of "Simplified is close, Traditional dominates" does not hold.
3.2 Case 1: In Japanese, kimono citations concentrate on a single comparison site
For "Kyoto kimono rental recommended" in Japanese, a single ranking site (launched in 2025, about 15 months old at observation time) was cited in 18 of 20 runs (90%). That one site accounts for most of the "Media" share (53.7%). The government tourism site was cited comparatively less.
This suggests AI-era visibility in this category may concentrate on a single purpose-built comparison site. We will track how this site's share moves as our key metric for the kimono category going forward.
3.3 Case 2: Chinese platforms were never cited, even for Chinese-language queries
Across the six Simplified and Traditional Chinese cells, Chinese platforms — Xiaohongshu, Mafengwo, Ctrip, Dianping, Weibo, Zhihu — were never cited once.
Even when asked in Chinese, AI cited Japan-side official sites and businesses' Chinese-language pages, with English-language Reddit appearing in some cells. In other words, when Chinese speakers use AI for this purpose, what they mostly receive is not information from the Chinese-language ecosystem, but information originating from the Japan side.
3.4 Case 3: An unexplained pattern remains in Simplified Chinese
One observation is not fully explained by the pattern above. In Simplified Chinese, aside from Chinese platforms, there are indexable comparison and ranking articles that AI could in principle reference (general media features on kimono rental, for example).
In practice, though, the Simplified Chinese kimono category is dominated by owned sites (54.8%) and public sites (17.8%); such comparison media are not the main sources cited. "Comparison media aren't cited because Chinese platforms aren't cited" does not fully account for this.
We cannot identify the cause at this time. We leave the conclusion open and flag it as an ongoing observation question.
3.5 Case 4: In zen meditation, providers' own information dominates
In zen meditation, providers' own official sites (mostly temples) or public sites dominated citations in every language. OTAs and affiliates were nearly absent. In English in particular, owned sites reached an 80.2% share.
This suggests that in categories where comparison media are scarce, information published by providers themselves tends to be cited by AI. We also confirmed that providers without an English-language page were rarely surfaced at all — publishing official information in multiple languages appears to be itself a visibility factor.
4. Business appearance rate (brand level, top group only)
This section looks at businesses actually named in responses and how they appeared.
What Report #000 can evaluate is limited to concentration within the top group; with no prior issue, we do not discuss month-over-month change here (see Section 5 for diffs). Note that citation source distribution (Section 3) and business appearance rate (this section) are different metrics: Section 3 looks at which sources were cited, while this section looks at which businesses were actually named in responses.
Kimono: Across all four languages, we found a top group of roughly 8 businesses that appeared in nearly every run, and this group overlaps substantially across Japanese, English, Simplified Chinese, and Traditional Chinese. The type of source cited differs by language, though — comparison media in Japanese, OTAs and travel media in English, official sites in Chinese (§3.1). In other words, what changes by language is which sources are the pathway, not which businesses ultimately get named.
Zen: Comparing all four languages, one business (internal ID) appeared most often in Japanese, Simplified Chinese, and Traditional Chinese, and ranked highly in English as well. This corroborates, at the business level, the §3.5 finding that in categories with scarce comparison media, providers' own information tends to get cited.
Tea ceremony: Tea ceremony also showed a top group of about 5 businesses largely consistent across all four languages, with no major difference between keyword-style and natural-language queries. As with kimono, the type of source cited varies by language, while the businesses AI actually surfaces show high consistency across the four languages.
A pattern common across languages: For kimono and tea ceremony, even though the type of source cited differs substantially by language, the businesses AI actually names are fairly consistent across all four. This suggests that what changes by language is which source AI references, not which business ultimately gets recommended.
Report #000 records this overlap as a baseline. We will track how it changes month over month from Report #001 onward.
5. Change from the previous issue
Report #000 is the baseline for this report series. There is no prior issue to compare against. We treat the results shown here as the baseline (t=0), and from Report #001 (September 2026) onward we will continuously track change from this baseline.
6. Comparison against the noise floor
The overlap in cited source sets (Jaccard index) between runs, when the same query was repeated 20 times, is as follows.
| JA | EN | zh-Hans | zh-Hant | |
|---|---|---|---|---|
| Tea ceremony | 0.25 | 0.20 | 0.31 | 0.25 |
| Kimono | 0.41 | 0.16 | 0.15 | 0.11 |
| Zen | 0.35 | 0.40 | 0.22 | 0.23 |
Even for the same query, more than half of the cited sources typically change between runs.
Japanese and English tea ceremony (0.247 / 0.204) land close to the value reported by Green et al. (0.265). This is one piece of evidence that the variance we independently observed is consistent with outside research.
We treat this variance as the "noise floor." When evaluating month-over-month change, we only treat movement beyond this baseline as a meaningful signal (see Appendix A for detail).
A single response (n=1) is therefore not enough to conclude "this is what AI says." Source-type composition converges to roughly ±10 points with 20 observations, while individual business appearance rates remain noisier — Report #000 evaluates only the top group for that reason.
7. Appendix
- A. Noise floor methodology and full data
- B. Definitions of the six source types (Public / Owned / OTA / Media / Directory / UGC) — see Section 2 of this article and Appendix A
- C. Raw data: data.csv (CC BY 4.0. 240 runs, 12 cells × n=20, 1,023 rows at the citation-domain level)
Next issue (September 2026): Report #001 will report the first change from this baseline, focusing on how the kimono category's comparison-media share moves, and continued verification of the unexplained observation noted in §3.4.
This is an independent research and information-sharing project, unaffiliated with any organization, university, or company. Data is published for free under CC BY 4.0 and is not for sale.