The content of research paper

Impact of general practice/family medicine training on Japanese junior residents:reflective writing analysis using text mining

Koki Nakamura, Satoshi Kanke, Atsushi Ishii, Fuyuto Mori, Goro Hoshi, Kanako Kanto, Yoshihiro Toyoda, Ryuki Kassai

Author information
  • Koki Nakamura

    Department of Community and Family Medicine, Fukushima Medical University School of Medicine
    Fukushima Centre for General Physicians, Fukushima Medical University
    Center for Medical Education and Career Development, Fukushima Medical University

  • Satoshi Kanke

    Department of Community and Family Medicine, Fukushima Medical University School of Medicine
    Fukushima Centre for General Physicians, Fukushima Medical University

  • Atsushi Ishii

    Kashima Hospital

  • Fuyuto Mori

    Kitakata Centre for Community and Family Medicine

  • Goro Hoshi

    Hoshi Yokozuka Clinic

  • Kanako Kanto

    Hobara Central Clinic

  • Yoshihiro Toyoda

    Department of Community and Family Medicine, Fukushima Medical University School of Medicine

  • Ryuki Kassai

    Department of Community and Family Medicine, Fukushima Medical University School of Medicine
    World Organization of Family Doctors

Introduction

General practice/family medicine (GP/FM) is part of community medicine and a clinical field expected to contribute not only to the provision of high-quality primary health care but also to medical education1). Internationally, postgraduate training reform efforts have been directed toward strengthening primary health care education2). Therefore, experience in GP/FM during postgraduate training would be beneficial to all junior residents, regardless of their future specialty choice3). Previous reviews have reported that GP/FM training has positive effects in terms of management of common diseases and chronic diseases, understanding of psychosocial factors of illness, communication skills, team medical care, and community care, as well as fostering better cooperation and understanding between primary care and secondary care doctors4,5). The primary care described in these international studies is assumed to be provided by specialists who have received specialized training in GP/FM2). In Japan, GP/FM specialist training has been developed and implemented. In 2020, The family medicine expert training program organized by the Japan Primary Care Association (JPCA) acquired international accreditation from the World Organization of Family Doctors6). With this accreditation, JPCA-certified family doctors are considered family medicine specialists trained to international standards6).


The initial postgraduate training period in Japan is two years, including one compulsory month of community medicine training in the second year7). The Department of Community and Family Medicine at Fukushima Medical University has provided community medicine training (known as GP/FM training) supervised by JPCA-certified family doctors at five medical institutions in Fukushima Prefecture. In May 2023, we reported the impact of GP/FM training using nationally-standardized evaluation criteria8). Our findings suggested that the GP/FM training may greatly contribute to the acquisition of various clinical abilities expected to be acquired during postgraduate training. However, there remained a possibility that the evaluation based on the standardized criteria may not have fully described what these junior residents learned, and a new insight may be gained by analyzing the text in their reflective reports. Qualitative appraisal of reflective texts may be confounded by the reader’s bias9); therefore, we used text mining to extract keywords (frequently used nouns) from a large sample of written texts in an efficient and objective manner. Text mining can also be used to identify relationships between extracted words by creating a co-occurrence network map10).


The purpose of the present study was to explore the effects of GP/FM training that cannot be measured by the established criteria by using text mining and analyzing texts written reflectively by the junior residents who participated in the training.

Materials and Methods

Participants and settings


The criteria for inclusion were second-year junior residents who participated in a one-month community medicine rotation between April 2019 and March 2022. The settings were five medical institutions (one hospital and four clinics) that had full-time family doctors. The junior residents were each assigned to one of these institutions.


Contents of GP/FM training


In general, postgraduate community medicine training covers general ambulatory care, home medical care, specialized care in a chronic and/or recovery stage ward, and community-based care in a real-world setting7). General ambulatory care training provides opportunities to learn about medical practice for new patients to prevent bias toward specific symptoms or illnesses, as well as for returning patients who require continued care for chronic disorders. In home medical care training, the junior residents visit patients’ homes together with the family doctors, and experience medical care in the context of the daily life of each patient and the characteristics of the community. Community-based care training provides an opportunity to learn about cooperation with a variety of community health providers such as medical and nursing care facilities, pharmacies, and welfare organizations. The junior residents are required to write a reflective report on the day’s events every evening, and they also receive daily feedback from the family doctors. Table 1 shows an example of the training schedule. In addition to the required training contents, there are some optional contents that differ depending on the training site.


Table 1.

An example of the training schedule


Data source


The sentences analyzed in this study were collected from the reflective texts submitted by the junior residents who were given the following instruction:“Please describe what you experienced today that made a particularly strong impression on you. What did you learn from it?” The original Japanese instruction was as follows:


「今日経験したことで、特に印象的だったエピソードを具体的に記載してください。そこから、どんなことを学びましたか」


The report was handwritten. The handwritten data was entered into a computer, and obvious typographical and grammatical errors were corrected before analysis.


Statistical analysis


Text mining was used to extract frequent words (nouns) from the junior residents’ free descriptions. In the Japanese language, some verbs contain a noun. For example, the verb 訪問する(houmonsuru) is a noun 訪問(houmon) with the verbalizing suffix する(suru). In the present study, all verbs containing a noun were divided into nouns and verb components, and were then counted separately. A co-occurrence network map was created to illustrate the relationships between the most frequently occurring words. Co-occurrence refers to how many times high-frequency words appear in the text in proximity to other high-frequency words10). This relationship is called an association, which is calculated numerically as a figure between 0 and 110,11). A co-occurrence network map was created to visualize how these keywords are grouped together in the entire text, with connecting lines marked with numerical values indicating association strength10). All analyses were performed using KH Coder 3.0 (http://khcoder.net/en/index.html), a free downloadable multilingual text-mining program developed by Koichi Higuchi, Ritsumeikan University, Japan12). The analysis was conducted on the original Japanese texts and the results were translated into English for publication. For reference, a list of extracted words and typical sentences is shown in the Results section.


Ethics approval


Ethics approval was obtained from the Fukushima Medical University Research Ethics.


Committee, approval number #2022-153.

Results

Ninety-five junior residents participated in the GP/FM training and ninety completed the study (95% participation rate). Their baseline characteristics are shown in Table 2. The total number of sentences collected was 4,903 and the total number of words including verbs and other parts of speech was 116,279. The average number of sentences written by a junior resident per day was 2.7. Table 3 shows the top 20 most frequent words. The top five frequent words were “patient,” “symptoms,” “medical examination,” “consultation,” and “family.” Examples of typical sentences in which extracted words are used are shown in both English and Japanese in Table 4. Fig. 1 shows the co-occurrence network map linking each frequently used word. The strongest co-occurrence relationship was recognized between “home visit” and “medical practice” (Jaccard coefficient 0.41). The next strongest co-occurrence relationship was recognized between “family” and “(patient) oneself” (本人) (Jaccard coefficient 0.15).


Table 2.

Baseline characteristics of junior residents


Table 3.

List of frequently used words


Table 4.

Translation of typical sentences containing extracted words


Fig. 1.

The co-occurrence network map between frequent words

A community refers to a group of words connected relatively strongly with each other. KH coder automatically detects a community, groups words belonging to that community, and shows these communities in different colors. Words that do not form communities with other words are shown in white. Words in the same community are connected with solid lines, while words in different communities but having association with each other are connected with dashed lines. The number on the line is the Jaccard coefficient. This coefficient is calculated between 0 and 1, and the numbers closer to 1 indicate a stronger relationship between the connected words.

Discussion

The top 20 most frequent words that appeared in sentences referring to clinical ability included “symptoms,” “medical examination,” “consultation,” “treatment,” “test, “disease,” “outpatient,” “explanation,” “prescription,” “diagnosis,” and “findings.” (see typical sentences A, B, C, D, E, F, and G in Table 4). In our previous study, which included the same participants as in this study, post self-evaluation of items related to clinical ability also increased compared to pre self-evaluation of GP/FM training8). By analyzing the reflective reports, we found that the reason was due to the GP/FM training complementing their previous training at core hospitals (such as university hospitals) (see typical sentences A, B, and C in Table 4) and that they were able to participate in and independently perform medical practice during the training (see typical sentences D, E, F, and G). Previous studies from other countries have reported that GP/FM training provides knowledge and skills that cannot be acquired in departmental training at hospitals13,14). Other studies have reported that the biggest difference in the learning environment between other hospital department training and GP/FM training is the increased responsibility that individual junior residents have regarding patient care; this greater responsibility further motivates the junior residents in their studies14,15).


It is noteworthy that the second strongest co-occurrence relationship was found between “family” and “(patient) oneself” from the co-occurrence network map. This suggests that junior residents learned a significant amount not only about patient care but also about family-oriented care (see typical sentences H and I in Table 4). In our aforementioned study, post self-evaluation of items related to the care for patient’s family also increased compared to pre self-evaluation of GP/FM training8). However, it was difficult to explore the learning of “not only the patient but also the family as the target of care”’ with the existing evaluation items; therefore, we suspected that this aspect could be explored by analyzing the reflective writing. Previous studies have shown that GP/FM training promotes greater understanding in junior residents regarding the impact of illnesses on the family members of patients, compared with training in other specialties16). In another previous study we conducted that analyzed the reflective writing of GP/FM clerkships of fifth-year medical students at Fukushima Medical University, “family” was the fifth most frequently used word, suggesting that the participants learned a lot about family-oriented care17). On the other hand, a study reported by another Japanese university showed that the top six frequent words used in the reflective reports of the fifth-year medical students attending community medicine clerkship was “patient,” “systemic treatment,” “locale,” “hospital,” “care,” and “training” but “family” was not included10). This suggests that substantial learning about family-oriented care may be a characteristic of GP/FM training and clerkship which, therefore, can be or should be included in learning objectives of GP/FM training, if it is not the primary objective.


“Home visit,” “medical practice,” and “life” appeared most frequently in the descriptions related to understanding a patient’s psychosocial background (see typical sentence J in Table 4). In the co-occurrence network map, the strongest relationship was found between “home visit” and “medical practice” because the two words are often used as a compound word “home-visit medical practice” (訪問診療). In our previous study, post self-evaluation of items related to psychosocial background also increased compared to pre self-evaluation of GP/FM training8). Previous studies from other countries have also reported that home visits are the starting point for understanding social and economic factors related to holistic medical care and patient’s clinical conditions18). Unlike outpatient care, home visit training involves actual visits to patient’s home where junior residents can learn about patient’s psychosocial background by observing their living environment and daily life. Among the top 20 frequently occurring words, “patient,” “person,” “medical care,” and “talk” were used extensively in a rather general context and it was difficult to find a characteristic meaning. In the co-occurrence network map, the Jaccard coefficient, excluding “home visit” and “medical practice”, “family” and “(patient) oneself”, was 0.1 or less. This is probably due to the amount of data. In this study, the total number of sentences was 4,903 and the total number of words was 116,279. We reported a study of medical students using a method similar to the present study17). In the previous study, the total number of sentences was 321 and the total number of words was 10,627, and the Jaccard coefficients of the co-occurrence network map were all 0.1 or higher. Therefore, it was suggested that co-occurrence was difficult to find in this study due to the large amount of data.


This study has several limitations. The first limitation is that the superiority of GP/FM training over other types of postgraduate training is not yet verified. Although there have been few prior studies comparing GP/FM training and other training, GP/FM training was reportedly equal to or better than other types of training in terms of education quality, acquisition of clinical skills, social support, and role independence14). Second, because the text data are student-reported outcomes, there might have been some self-reporting bias. It is possible that the junior residents made positive statements out of gratitude and/or consideration for the family doctors supervising them. Third, although it is possible to explore learning using text mining, it is not possible to accurately evaluate it.

Conclusions

This study used text mining to analyze reflective texts written by junior residents who underwent GP/FM training. It was suggested that GP/FM training greatly contributes to the acquisition of clinical abilities due to the GP/FM training complementing their previous training at core hospitals and junior residents were able to participate in and independently perform medical practice during the GP/FM training. In addition, our results also suggest that GP/FM training enabled substantial learning not only about patient care, but also family-oriented care.

Acknowledgments

We would like to thank Professor Aya Goto of the Center for Integrated Sciences and Humanities at Fukushima Medical University for her useful comments on the design of the study.


We also thank Chisato Kubo of the Office for Diversity Support at Fukushima Medical University, for inputting the data.


We also wish to thank the Scientific English Editing Section of Fukushima Medical University.

Conflicts of interest disclosure

The authors declare no conflicts of interest.