We have undertaken a rigorous, systematic, curriculum defining process employing evidence provided by MSK US experts. This has resulted in the establishment of 10 generic core competencies and 61 anatomically specific “must know” core competencies (tables 4, 5, and 6) which represent the minimum standard of knowledge and skills required by all rheumatologists who undertake MSK US examinations. In addition, 52 MSK US skills were deemed most appropriate at an intermediate (18 of 115 “should know”) or advanced level (34 of 115 “could know”), and 28 were considered inappropriate or unnecessary for rheumatologist ultrasonographers (tables 5 and 6).
Table 6Specific competency outcomes – lower limb
Our proposed competency based approach to the education of rheumatologists in MSK US, including the development of specific learning outcomes, has several advantages. Learning outcomes are broad statements of what is achieved and assessed at the end of a training programme24
and as such, these outcomes form criteria against which the students and ultimately the course may be judged.25
Explicit learning outcomes enable effective planning and delivery of an appropriate teaching and learning programme to permit learners to achieve these standards. They also enable the development of the most appropriate system of assessment to demonstrate achievement of these outcomes. Additionally, students know exactly what is expected of them, allowing them to take responsibility and learn more effectively. Teachers can design and plan appropriate student learning programmes based on the outcome template, using effective teaching strategies and employing efficient use of resources.26
Specific competency outcomes encourage future informed educational development as they can be matched to the content of the curriculum and assessment process.27
There are several interesting findings in the assignment of the final competency designations. MSK US skills associated with inflammatory arthritis scored highly with little diversity of opinion within the expert group, perhaps reflecting a common indication for a rheumatologist to undertake an ultrasound assessment20
and an area in which there may be less conflict with radiology practice. Tendon pathology around the shoulder and knee was assigned a range of final competency categories that perhaps indicates the increased specialisation required to carry out a competent MSK US assessment for these indications. The use of MSK US to guide practical procedures such as joint aspiration and injection was judged a core skill in all anatomical areas except the hip, where it can be a more technically difficult procedure and may demand a more advanced level of knowledge and proficiency. Intermetatarsal bursitis was classified as “could know” and plantar fasciitis “should know”, although if the rheumatologists' responses alone were used, these items would have reached “must know” grade. In our experience, these are areas in which MSK US can provide important clinically relevant information, so they should be considered as valuable skills for rheumatologists.
If the data are divided by specialty, it is possible to make several observations. Significant differences in responses between the two specialist groups were more commonly seen with respect to skills in the larger joints rather than the peripheral smaller joints. The rheumatologists tended to place items in a higher competency category than the radiologists. The radiologists therefore imply that competency requires a higher level of specialisation, skill, and experience together with a more thorough and prolonged period of training. That is not to say that they think that rheumatologists should not be undertaking MSK US for these indications, as only seven of 115 items were categorised as “don't need to know” by the radiologist experts. Indeed, most of the areas considered inappropriate for rheumatologist ultrasonography have already been identified,21
which allowed the construction of a more informed data collection instrument resulting in a low rate of rejection of items. The diversity of responses between specialist groups in some areas may partly be related to the enthusiasm of the rheumatologist to develop and apply a new, clinically useful skill, versus a more moderate opinion from the radiologist that there should be some control over how much MSK US it is appropriate for a non‐radiologist to undertake, based on the level of technical skill and training required and the possible overlap with their own practice. This situation may also be influenced by a background culture of more traditional orthopaedic related ultrasound practice, with a bias towards a more surgically oriented management strategy—as opposed to the less well established rheumatological approach incorporating an MSK US examination at the same time as clinical assessment, often by the same physician, as a complementary tool to facilitate diagnosis and management decisions or assess disease activity and outcome. These observations may also be reflected in the relatively reduced response rate of radiologists compared with rheumatologists. However, all of our panelists, regardless of their specialty background, fulfil our strict expert selection criteria, so although it is interesting to highlight areas of disparity between the different specialists, it is important to consider the responses of the expert group as a whole to ensure an appropriate balance of opinion and therefore an objective conclusion. In addition, the inclusion of relevant stakeholders from different informed specialty backgrounds adds to the validity of these data.
Critical appraisal of each MSK US skill and free text comments were encouraged throughout the questionnaire. It was intended to use these qualitative data to provide further insights into the justification and reasons for the respective opinions and to explain or resolve any differences. However, this qualitative data analysis resulted in the reclassification of only a single skill, with the designation of calcified cartilage in the shoulder to the “could know” competency category. There were no other sufficiently frequent themes to justify modification of competency category designations among the remainder of the MSK US skills, and the comments that were made merely endorsed their suitability. This may reflect the satisfaction of the experts with both the rheumatology MSK US skill set presented to them in the questionnaire and their firm opinion with regard to the designation of appropriate competency categories. This provides further corroboration of the accuracy and validity of the final generic and specific competency outcomes.
In the absence of a significant evidence base, we used authoritative testimony from international experts, who represented a broad heterogeneous sample of experienced informed professionals with a track record of teaching, research, and active MSK US practice over a number of years. All experts satisfied strict criteria to justify such a status in an attempt to maximise the validity of our findings, with a balance of specialty backgrounds in radiology and rheumatology. To ensure continuity of development, all of these experts had been involved in the preceding stages of the project.20,21
This contributed to an excellent response rate, which may also reflect the high level of importance, interest, and motivation from expert MSK US practitioners in this study. These factors increase the prospect of widespread acceptance and implementation of our recommendations.
Exhaustive efforts were undertaken to ensure that the MSK US skills included in the data collection document were comprehensive, valid, and reliable. A clinical context is integral to the role of MSK US within rheumatology practice and attempts were made to reflect this with the development of an MSK US skill set that accurately reflects both rheumatology and appropriate radiology practice. This is supported by the participation of a near equal mix of rheumatologist and radiologist experts. This process involved a thorough Medline literature review, focus group interviews with radiologists and rheumatologists, together with analysis of expert practice data.20
In addition, the MSK US skills that were eventually included in the questionnaire had all been classified by expert consensus agreement as necessary knowledge and skills for rheumatologist ultrasonographers.21
Even though some of these MSK US skills lack formal definition, all were derived from relevant evidence and consultation. Indeed, as part of their ongoing engagement in this process, each expert was given the opportunity on at least two previous occasions to interact and modify this list. This ensures a precise and reliable skill set and consistent understanding and interpretation of the nomenclature by all respondents in the context of rheumatology practice. The suitability of these competency items was reflected in the qualitative data, with relatively few modifications being recommended by the expert panel, despite prompting. The suggested alterations mainly consisted of additional skills that almost exclusively fell into the categories of soft tissue mass lesion, muscle, ligament and nerve pathology, and degenerative arthritis—all previously designated as not appropriate or necessary for MSK US examination by a rheumatologist.21
The remainder were suggested by a single expert and represent more specialist areas, thereby justifying non‐inclusion in this list of key rheumatology MSK US skills.
We considered using Delphi methodology21
by presenting feedback of the group responses from this present study to the individual experts and offering them time to reflect and change their original answers in the light of the collective opinion of the group. However, our previous experience with the same expert panel revealed relatively little change in individual scores between rounds.21
This perhaps reflects the confidence of experienced practitioners who have developed their own firm views that are unlikely to be changed by the opinions of others. This implies that despite a lack of formal feedback, our data are likely to represent accurate and consistent judgments. It may be more constructive to present these data to another expert group such as other radiologists or rheumatologists in order to further enhance the validity and reliability of our findings. For example, it may be advantageous to obtain the opinion of other rheumatologists as to the clinical relevance of these proposals and incorporate these views in the development of such a syllabus. Acknowledging these requirements may encourage wider dissemination of this imaging technique by providing more clearly defined, clinically focused learning outcomes in line with both imaging expert and consumer rheumatologist opinion. In addition, it would be pertinent to submit our data and proposals to relevant rheumatology and radiology authorities as a stimulus for discussion on the formal endorsement of recognised guidelines for MSK US training and practice.
Limited guidance is available for rheumatologists undertaking MSK US, current practice is not universally standardised, and there is no unified international approach to training or assessment, which is often undertaken in the absence of published evidence based educational requirements. However, good clinical practice demands that competency standards are clear, realistic, justifiable, documented, and available to all stakeholders. We have therefore conducted a thorough analysis to establish specific, expert derived, competency based learning outcomes for rheumatologist ultrasonographers. We have established a set of robust principles based on the evidence of experienced expert MSK US practitioners, which represent a foundation for further informed educational development. This competency model provides a framework for the future training of rheumatologists in MSK US and signifies a significant step forward in this expanding discipline. We hope that this study provides relevant information to promote consultation between all of the appropriate stakeholders with the aim of establishing a universal agreement of standards for education and practice for the rheumatologist ultrasonographer.