<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20130521//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" article-type="review-article">
<front>
<journal-meta>
<journal-id journal-id-type="nlm-ta">J Oral Maxillofac Res</journal-id>
<journal-id journal-id-type="publisher-id">JORM</journal-id>
<journal-title-group>
<journal-title>Journal of Oral &amp; Maxillofacial Research</journal-title>
</journal-title-group>
<issn pub-type="epub">2029-283X</issn>
<publisher>
<publisher-name>Stilus Optimus</publisher-name>
<publisher-loc>Kaunas, Lithuania</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">v14n1e1ht</article-id>
<article-id pub-id-type="doi">10.5037/jomr.2023.14101</article-id>

<article-categories>
<subj-group subj-group-type="heading">
<subject>Literature Review</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Accuracy of Orthognathic Surgical Planning using Three-dimensional Virtual Techniques compared with Conventional Two-dimensional Techniques: a Systematic Review</article-title>
</title-group>

<contrib-group>
<contrib contrib-type="author" id="contrib1" corresp="yes">
<name>
<surname>Starch-Jensen</surname>
<given-names>Thomas</given-names>
</name>
<xref ref-type="aff" rid="aff1">1</xref>
</contrib>
<contrib contrib-type="author" id="contrib2">
<name>
<surname>Hernández-Alfaro</surname>
<given-names>Federico</given-names>
</name>
<xref ref-type="aff" rid="aff2">2</xref>
<xref ref-type="aff" rid="aff3">3</xref>
</contrib>
<contrib contrib-type="author" id="contrib3">
<name>
<surname>Kesmez</surname>
<given-names>Özlem</given-names>
</name>
<xref ref-type="aff" rid="aff1">1</xref>
</contrib>
<contrib contrib-type="author" id="contrib4">
<name>
<surname>Gorgis</surname>
<given-names>Romario</given-names>
</name>
<xref ref-type="aff" rid="aff4">4</xref>
</contrib>
<contrib contrib-type="author" id="contrib5">
<name>
<surname>Valls-Ontañón</surname>
<given-names>Adaia</given-names>
</name>
<xref ref-type="aff" rid="aff2">2</xref>
<xref ref-type="aff" rid="aff3">3</xref>
</contrib>
</contrib-group>

<aff id="aff1" rid="aff1">
<sup>1</sup>
<institution>Department of Oral and Maxillofacial Surgery, Aalborg University Hospital, Aalborg</institution><country>Denmark</country>
</aff>
<aff id="aff2" rid="aff2">
<sup>2</sup>
<institution>Institute of Maxillofacial Surgery, Teknon Medical Centre Barcelona, Barcelona</institution><country>Spain</country>
</aff>
<aff id="aff3" rid="aff3">
<sup>3</sup>
<institution>Department of Oral and Maxillofacial Surgery, Universitat Internacional de Catalunya, Sant Cugat del Vallès, Barcelona</institution><country>Spain</country>
</aff>
<aff id="aff4" rid="aff4">
<sup>4</sup>
<institution>Department of Oral and Maxillofacial Surgery, Aarhus University Hospital, Aarhus</institution><country>Denmark</country>
</aff>

<author-notes>
<corresp>Thomas Starch-Jensen, 
<institution>Department of Oral and Maxillofacial Surgery</institution>
<institution>Aalborg University Hospital</institution>
<addr-line>18-22 Hobrovej, DK-9000 Aalborg</addr-line>
<country>Denmark</country>
<phone>+45 97 66 27 98</phone>
<fax>+45 97 66 28 25</fax>
<email>thomas.jensen@rn.dk</email>
</corresp>
</author-notes>

<pub-date pub-type="collection">
<season>Jan-Mar</season>
<year>2023</year>
</pub-date>
<pub-date pub-type="epub">
<day>31</day>
<month>3</month>
<year>2023</year>
</pub-date>
<volume>14</volume>
<issue>1</issue>
<elocation-id>e1</elocation-id>
<history>
<date date-type="received">
<day>2</day>
<month>3</month>
<year>2023</year>
</date>
<date date-type="accepted">
<day>24</day>
<month>3</month>
<year>2023</year>
</date>
</history>
<permissions>

<copyright-statement>Copyright &#169; Starch-Jensen T, Hernández-Alfaro F, Kesmez Ö, Gorgis R, Valls-Ontañón A. Published in the JOURNAL OF ORAL &amp; MAXILLOFACIAL RESEARCH (http://www.ejomr.org), 31 March 2023.
</copyright-statement>
<copyright-year>2023</copyright-year>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by-nc-nd/3.0/">
<license-p>
This is an open-access article, first published in the JOURNAL OF ORAL &amp; MAXILLOFACIAL RESEARCH, distributed under the terms of the Creative Commons Attribution-Noncommercial-No Derivative Works 3.0 UnportedLicense (http://creativecommons.org/licenses/by-nc-nd/3.0/), which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work and is properly cited. The copyright, license information and link to the original publication on (http://www.ejomr.org) must be included.</license-p>
</license>
</permissions>

<self-uri xlink:href="http://www.ejomr.org/JOMR/archives/2023/1/e1/v14n1e1ht.htm" xlink:type="simple"/>


<abstract>
<title>ABSTRACT</title>
<sec sec-type="objectives">
<title>Objectives</title>
<p>The objective was to assess the accuracy of orthognathic surgical planning using three-dimensional virtual planning compared with conventional two-dimensional planning. </p>
</sec>
<sec sec-type="material and methods">
<title>Material and Methods</title>
<p>MEDLINE (PubMed), Embase and Cochrane Library search combined with hand-search of relevant journals was conducted to identify randomized controlled trials (RCTs) published in English through August 2<sup>nd</sup>, 2022. Primary outcomes included postsurgical accuracy of hard and soft tissue. Secondary outcomes included treatment planning time, intraoperative time, intraoperative blood loss, complications, financial expenses, and patient-reported outcome measures (PROMs). Quality and risk-of-bias assessment were evaluated by Cochrane risk of bias tool and GRADE system. </p>
</sec>
<sec sec-type="results">
<title>Results</title>
<p>Seven RCTs characterised by low, high, and unclear risk of bias fulfilled inclusion criteria. Included studies disclosed conflicting results regarding accuracy of hard and soft tissue as well as treatment planning time. The intraoperative time was shortened, and financial expenses were increased with three-dimensional virtual surgical planning (TVSP), while no planning-related complications were revealed. Comparable improvement in PROMs were reported with TVSP and two-dimensional planning.</p>
</sec>
<sec sec-type="conclusions">
<title>Conclusions</title>
<p>Future orthognathic surgical planning will indisputable be performed by three-dimensional virtual planning. The financial expenses, treatment planning time, and intraoperative time will therefore probably decrease due to further development of three-dimensional virtual planning techniques. The hard and soft tissue accuracy between planned position and achieved surgical outcome seems to be improved by three-dimensional virtual planning compared with two-dimensional planning, although results are inconsistent. Further development of three-dimensional virtual planning involving cutting guides and patient-specific osteosynthesis plates are therefore needed to improve the accuracy of orthognathic surgical planning.</p>
</sec>
</abstract>

<kwd-group>
<kwd>orthognathic surgery</kwd>
<kwd>review</kwd>
<kwd>surgery</kwd>
<kwd>treatment</kwd>
<kwd>virtual planning</kwd>
</kwd-group>
</article-meta>
</front>

<body>
<sec sec-type="intro">
<title>INTRODUCTION</title>
<p>Pronounced malocclusion combined with a dentofacial deformity are commonly treated by orthognathic surgery involving either single jaw or bimaxillary surgery. Previous published systematic reviews have demonstrated significant improvement in facial aesthetics, masticatory function, obstructive sleep apnoea and oral health-related quality of life (OHRQoL) following orthognathic surgery [<xref ref-type="bibr" rid="B1">1-5</xref>]. However, a predictable and successful treatment outcome following orthognathic surgery necessitates a meticulous and detailed preoperative treatment plan including clinical and radiographic transmission of the dentition and dentofacial deformity with high accuracy. Moreover, predictable implementation of the treatment plan to the surgical setting is a prerequisite for accurate intraoperative repositioning of the bony segments to obtain a satisfying functional outcome and aesthetic [<xref ref-type="bibr" rid="B6">6-8</xref>]. Ensuring predictable and accurate transmission of the preoperative treatment plan to the operating theatre is thus crucial to achieve the planned postsurgical outcome. </p>
<p>Conventional surgical planning of dentofacial deformities involves reproduction of the occlusal discrepancy on a fully or semi adjustable articulator through facebow transfer of cast model, two-dimensional cephalometric analysis, mock surgery, and manual fabricated acrylic occlusal splints. However, two-dimensional surgical planning (TSP) using mock surgery contain potential risk of errors and inaccuracies related to the impression, facebow transfer, radiographic distortion, surgical simulation, and intraoperative repositioning of the bony segments [<xref ref-type="bibr" rid="B9">9</xref>,<xref ref-type="bibr" rid="B10">10</xref>]. Moreover, TSP is inadequate for detailed analysis of facial asymmetries, which compromises the predictability and accuracy of orthognathic surgery in patients with severe dentofacial asymmetries and occlusal canting [<xref ref-type="bibr" rid="B11">11-13</xref>]. </p>
<p>Emerging of three-dimensional technologies and computer software programs has facilitated novel methods for three-dimensional virtual surgical planning (TVSP) of dentofacial deformities without the need of facebow registration and plaster dental models. Computed tomography (CT) and cone-beam computed tomography (CBCT) combined with computer-assisted technology enables acquisition of three-dimensional images of the craniofacial complex and detailed implementation of a three-dimensional treatment plan, virtual surgeries, and manufacturing of computer-generated occlusal splints. Application of three-dimensional technologies for orthognathic surgical planning of dentofacial deformities is therefore anticipated to diminish treatment planning inaccuracies and significantly improve the surgical accuracy [<xref ref-type="bibr" rid="B12">12</xref>]. </p>
<p>Previous published systematic reviews assessing surgical precision of hard and soft tissue following orthognathic surgery have demonstrated comparable or higher accuracy with TVSP compared with TSP [<xref ref-type="bibr" rid="B12">12-14</xref>]. However, the required time for treatment planning, operating theatre time, intraoperative blood loss, intra- and postoperative complications, financial expenses, and patient-reported outcome measures (PROMs) are also important considerations when assessing the best applicable treatment planning technique for correction of dentofacial deformities. Recent published systematic reviews concluded that TVSP shorten the overall treatment planning time compared with TSP [<xref ref-type="bibr" rid="B15">15-17</xref>]. Moreover, equivalent financial expenses and comparable improvement in OHRQoL have been reported with TVSP and TSP [<xref ref-type="bibr" rid="B13">13</xref>]. Thus, TVSP seems too beneficial improve the predictability and accuracy of hard and soft tissue as well as other parameters in orthognathic surgery compared with TSP. However, discrepancies of more than 2 mm between the planned and the actual surgical outcome following orthognathic surgery have been reported with TVSP and TSP, respectively [<xref ref-type="bibr" rid="B18">18</xref>,<xref ref-type="bibr" rid="B19">19</xref>]. Moreover, inaccuracies of up to 5 mm between the planned and the postsurgical position of the maxilla have been described following TSP using mock surgery [<xref ref-type="bibr" rid="B20">20</xref>]. Consequently, a systematic comparison of TVSP and TSP concerning the predictability and accuracy of the preoperative treatment plan to accomplish the planned postsurgical outcome is needed. The primary objective of the present systematic review is therefore to assess the predictability and accuracy of orthognathic surgical planning using TVSP techniques compared with TSP. </p>
</sec>

<sec sec-type="materials|methods">
<title>MATERIAL AND METHODS</title>
<p><bold>Protocol and registration</bold></p>
<p>The present systematic review was conducted in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement for reporting systematic reviews [<xref ref-type="bibr" rid="B21">21</xref>]. The methods of the analysis and inclusion criteria were specified in advance and documented in a protocol and registered in PROSPERO, an international prospective register of systematic reviews. </p>
<p>Registration number: CRD42022350881</p>
<p>The protocol can be accessed at:</p>
<p><uri>https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42022350881</uri>.</p>
<p><bold>Focus question</bold></p>
<p>The focus question was created according to the Patient, Intervention, Comparison and Outcome (PICO) framework as described in <xref ref-type="table" rid="T1">Table 1</xref>. </p>

<table-wrap id="T1" position="float">
<label>Table 1</label>
<caption>
<p>
PICOS guidelines
</p>
</caption>
<table frame="hsides" rules="groups">
<tbody>
<tr>
<td align="left">
<bold>Patient and</bold><break /><bold>population (P)</bold></td>
<td align="left">Healthy patients older than 18 years with severe dental malocclusion combine with dentofacial deformities necessitating orthognathic surgery.

</td>
</tr>
<tr>
<td colspan="2"><hr/></td>
</tr>
<tr>
<td align="left">
<bold>Intervention (I)</bold></td>
<td align="left">Three-dimensional virtual surgical planning of orthognathic surgery. 
</td>
</tr>
<tr>
<td colspan="2"><hr/></td>
</tr>
<tr>
<td align="left">
<bold>Comparator or</bold><break /><bold>control group (C)</bold></td>
<td align="left">Two-dimensional surgical planning of orthognathic surgery using cephalometric analysis and model surgery.

</td>
</tr>
<tr>
<td colspan="2"><hr/></td>
</tr>
<tr>
<td align="left">
<bold>Outcomes (O)</bold></td>
<td align="left">Primary outcomes included surgical accuracy of hard and soft tissue. Secondary outcomes included required treatment planning time, time in the operating theatre, intraoperative blood loss, intra- and postoperative complications, financial expenses, and patient-reported outcome measures.

</td>
</tr>
<tr>
<td colspan="2"><hr/></td>
</tr>
<tr>
<td align="left">
<bold>Study design (S)</bold></td>
<td align="left">Randomized controlled trials.

</td>
</tr>
<tr>
<td colspan="2"><hr/></td>
</tr>
<tr>
<td align="left">
<bold>Focused question</bold></td>
<td align="left">Are there any differences in the predictability and accuracy of orthognathic surgical planning using three-dimensional virtual surgical planning techniques compared with two-dimensional surgical planning?
</td>
</tr>
</tbody>
</table>
</table-wrap>

<p><bold>Eligibility criteria for considering studies for this review</bold></p>
<p>Randomized controlled trials assessing the predictability and accuracy of orthognathic surgical planning using TVSP techniques compared with TSP were included. </p>
<p><bold>Types of outcome measures</bold></p>
<p><bold><italic>Primary outcome</italic></bold></p>
<p>Surgical accuracy of hard and soft tissue as evaluated by the difference in treatment plan measurements and actual surgical outcome based on cephalometric radiograph, CT, CBCT, photos or other valid assessment methods.</p>
<p><bold><italic>Secondary outcome</italic></bold></p>
<list list-type="bullet" id="L1">
<list-item>
<p>Treatment planning time including total required time for the treatment planning procedure as well as preparing necessary material or other specified time periods. </p>
</list-item>
<list-item>
<p>Time in the operating theatre, from beginning of the surgical procedure to the end of the surgical procedure or other specified intraoperative time periods.</p>
</list-item>
<list-item>
<p>Intraoperative blood loss.</p>
</list-item>
<list-item>
<p>Complications related to preparation, transmission, and implementation of the surgical treatment plan. </p>
</list-item>
<list-item>
<p>Financial expenses including cost-effectiveness as well as required length of treatment planning time, occupation of the operating theatre, and length of hospitalization.</p>
</list-item>
<list-item>
<p>PROMs including OHRQoL assessment as evaluated by interview, questionnaire, or visual analogue scale.</p>
</list-item>
</list>
<p><bold>Information sources</bold></p>
<p>The search strategy incorporated examinations of electronic databases, supplemented by a thorough hand-search page by page of relevant journals including “British Journal of Oral and Maxillofacial Surgery”, “International Journal of Oral and Maxillofacial Surgery”, “Journal of Oral &amp; Maxillofacial Research”, “Journal of Craniofacial Surgery”, “Journal of Cranio-Maxillo-Facial Surgery”, “Journal of Oral and Maxillofacial Surgery”, “Medicina Oral Patologia Oral y Cirugia Bucal”, “Oral and Maxillofacial Surgery” and “Oral Surgery Oral Medicine Oral Pathology Oral Radiology”. The manual search also included the bibliographies of all articles selected for full-text screening as well as previously published reviews relevant for the present systematic review. Two reviewers (T.S-J and Ö.K.) independently performed the search. In the event of disagreement, another reviewer was consulted (A.V.O.)</p>
<p><bold>Search strategy for identification of studies</bold></p>
<p>A MEDLINE (PubMed), Embase, and Cochrane Library search was conducted. Human studies published in English through August 2nd, 2022 were included. Grey literature, unpublished literature as well as other databases like Scopus, Google Scholar, or Research Gate were not included in the search strategy of the present systematic review. Search strategy was performed in collaboration with a librarian and utilized a combination of Medical subject heading (MeSH) and free text terms. A detailed description of the search strategy is presented in <xref ref-type="app" rid="app1">Appendices 1 to 4</xref>.</p>
<p><bold>Selection of studies</bold></p>
<p>PRISMA flow diagram presents an overview of the selection process (<xref ref-type="fig" rid="fig1">Figure 1</xref>). Titles of identified reports were initially screened with duplicates removed. Abstracts were assessed when titles indicated that the study was relevant. Full-text analysis was obtained for those with apparent relevance or when the abstract was unavailable. References of papers identified and previously published systematic reviews assessing TVSP and TSP in conjunction with orthognathic surgery were cross-checked for unidentified articles. Study selection was performed by two reviewers (T.S-J. and Ö.K.). In the event of disagreement between the reviewers, another reviewer was consulted (A.V.O.). The level of agreement between the reviewers was tested using the Cohen’s kappa coefficient (k). </p>

  <fig id="fig1">
  <label>Figure 1</label>
  <caption>
  <p>
PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow diagram demonstrating results of systematic literature search. Electronic search resulted in 563 entries.
  </p><p>
No articles were identified through hand-searching.
  </p><p>
Of these 563 articles, 196 were excluded because they had been retrieved in more than one search.
  </p><p>
A total of 34 abstracts were reviewed and full-text analysis included 17 articles.
  </p><p>
Seven randomized controlled trials were finally included.
  </p>
  </caption>
  <graphic xlink:href="jomr-14-e1-g001.tiff"/>
  </fig>

<p><bold>Inclusion criteria</bold></p>
<p>Randomized controlled trials in humans assessing the predictability and accuracy of orthognathic surgical planning using TVSP and TSP were included by addressing the previously described outcome measures. Moreover, at least ten patients should be included, and the used treatment planning technique should be clearly specified. </p>
<p><bold>Exclusion criteria</bold></p>
<p>Studies including syndromic craniosynostosis, cleft-palate, surgical-first approach or skeletal deformities resulting from trauma or tumour resection were excluded. Moreover, letters, editorials, PhD theses, letters to the editor, case reports, abstracts, technical reports, conference proceedings, cadaveric studies, animal or <italic>in vitro</italic> studies, and literature review papers were also excluded. </p>
<p><bold>Data extraction</bold></p>
<p>Data were extracted by one reviewer (T.S-J.) according to a predefined data-collection form ensuring systematic recording of the outcome measures. In addition, relevant characteristics of the study were recorded. Corresponding authors were contacted by e-mail in the absence of important information or ambiguities.</p>
<p><bold>Data items</bold></p>
<p>Following items were collected and arranged in following fields: author, number of patients, dentofacial deformity, treatment planning technique, planning instrument, surgical procedure, assessment methods, observation period, surgical accuracy of hard and soft tissue, treatment planning time, time in operating theatre, intraoperative blood loss, intra- and postoperative complications, financial expenses, and PROMs. </p>
<p><bold>Quality and risk-of-bias assessment</bold></p>
<p>Quality assessment was undertaken by two review authors (R.G. and T.S-J.) as part of the data extraction process. Cochrane Collaboration’s tool for assessing the risk of bias suggested in the Cochrane Handbook for Systematic Reviews of Interventions was used for included randomized controlled trials (version 5.1.0) [<xref ref-type="bibr" rid="B22">22</xref>]. Following items were evaluated:</p>
<list list-type="bullet" id="L2">
<list-item>
<p>Random sequence generation;</p>
</list-item>
<list-item>
<p>Allocation concealment;</p>
</list-item>
<list-item>
<p>Blinding of participants and personnel;</p>
</list-item>
<list-item>
<p>Blinding of outcome assessment;</p>
</list-item>
<list-item>
<p>Incomplete outcome data addressed;</p>
</list-item>
<list-item>
<p>Selective reporting.</p>
</list-item>
</list>
<p>Publications were grouped into the following categories [<xref ref-type="bibr" rid="B23">23</xref>]: low risk of bias (possible bias not seriously affecting results) if all criteria were met, high risk of bias (possible bias seriously weakening reliability of results) if one or more criteria were not met, and unclear risk of bias when too few details were available for classification as high or low risk. </p>
<p>Moreover, the GRADE system (Grading of Recommendations, Assessment, Development and Evaluations) was used for evaluation of the included studies [<xref ref-type="bibr" rid="B24">24</xref>].</p>

<p><bold>Statistical analysis</bold></p>
<p>The outcome measures were evaluated by descriptive statistics. Parametric data involving surgical accuracy of hard and soft tissue, treatment planning time, and time in operating theatre are presented as mean and standard deviation (M [SD]) in the tables.</p>
<p>Meta-analysis was conducted if the included studies were of similar comparison and reporting identical outcome measures.</p>
</sec>

<sec sec-type="results">
<title>RESULTS</title>
<p><bold>Study selection</bold></p>
<p>Search results are outlined in <xref ref-type="fig" rid="fig1">Figure 1</xref>. Electronic search resulted in 563 entries. No articles were identified through hand-searching. Of these 563 articles, 196 were excluded due to being retrieved in more than one search. A total of 34 abstracts were reviewed and full-text analysis included 17 articles. Finally, seven randomized controlled trials were included [<xref ref-type="bibr" rid="B25">25-31</xref>]. The level of agreement between the two authors (T.S-J. and Ö.K) in selecting abstracts and studies to be read in full text were measured at k = 0.97 and 0.94, indicating almost perfect reliability of agreement.</p>
<p><bold>Exclusion of studies</bold></p>
<p>Reasons for excluding 10 studies after full-text assessment were: not a randomized controlled trial (n = 2) [<xref ref-type="bibr" rid="B32">32</xref>,<xref ref-type="bibr" rid="B33">33</xref>], TSP was not used in the study (n = 2) [<xref ref-type="bibr" rid="B34">34</xref>,<xref ref-type="bibr" rid="B35">35</xref>], identical patient sample were reported in one of the included studies (n = 5) [<xref ref-type="bibr" rid="B36">36-40</xref>], conference abstract (n = 1) [<xref ref-type="bibr" rid="B41">41</xref>].</p>
<p><bold>Quality assessment</bold></p>
<p>The quality of the included studies is summarized in <xref ref-type="fig" rid="fig2">Figures 2</xref> and <xref ref-type="fig" rid="fig3">3</xref>. Two studies were characterised by low risk of bias [<xref ref-type="bibr" rid="B27">27</xref>,<xref ref-type="bibr" rid="B31">31</xref>], one study with high risk of bias [<xref ref-type="bibr" rid="B30">30</xref>], and four studies with unclear risk of bias [<xref ref-type="bibr" rid="B25">25</xref>,<xref ref-type="bibr" rid="B26">26</xref>,<xref ref-type="bibr" rid="B28">28</xref>,<xref ref-type="bibr" rid="B29">29</xref>].</p>

  <fig id="fig2">
  <label>Figure 2</label>
  <caption>
  <p>
Risk of bias summary.
  </p>
  </caption>
  <graphic xlink:href="jomr-14-e1-g002.tiff"/>
  </fig>

  <fig id="fig3">
  <label>Figure 3</label>
  <caption>
  <p>
Risk of bias graph.
  </p>
  </caption>
  <graphic xlink:href="jomr-14-e1-g003.tiff"/>
  </fig>

<p>According to the GRADE system, two studies displayed a high grade [<xref ref-type="bibr" rid="B27">27</xref>,<xref ref-type="bibr" rid="B31">31</xref>], while the other five studies displayed a low grade [<xref ref-type="bibr" rid="B25">25</xref>,<xref ref-type="bibr" rid="B26">26</xref>,<xref ref-type="bibr" rid="B28">28-30</xref>]. The reason for downgrading was mainly the lack of blinding.</p>
<p><bold>Characteristics of the studies included</bold></p>
<p>The included studies of the present systematic review consisted of seven randomized controlled trial [<xref ref-type="bibr" rid="B25">25-31</xref>]. Adult patients (≥ 18 years) with malocclusion and a dentofacial deformity in need of orthognathic surgery were enrolled [<xref ref-type="bibr" rid="B25">25-31</xref>]. Detailed description of the used power analysis and sample size calculation, in which the mean linear distance between the planned and actual postoperative position was chosen as the primary outcome variable was described in one of the included studies [<xref ref-type="bibr" rid="B31">31</xref>]. Consolidated Standards of Reporting Trials (CONSORT) were followed in two studies [<xref ref-type="bibr" rid="B27">27</xref>,<xref ref-type="bibr" rid="B31">31</xref>]. A single-blind [<xref ref-type="bibr" rid="B27">27</xref>,<xref ref-type="bibr" rid="B31">31</xref>] or double-blind study design [<xref ref-type="bibr" rid="B27">27</xref>] were applied, while no information of blinding was provided in studies [<xref ref-type="bibr" rid="B25">25</xref>,<xref ref-type="bibr" rid="B26">26</xref>,<xref ref-type="bibr" rid="B28">28-30</xref>]. Age and gender distribution as well as inclusion criteria and exclusion criteria were specified in all the included studies [<xref ref-type="bibr" rid="B25">25-31</xref>]. The surgical procedures included bimaxillary surgery [<xref ref-type="bibr" rid="B25">25-31</xref>], bimaxillary surgery with or without genioplasty [<xref ref-type="bibr" rid="B25">25</xref>,<xref ref-type="bibr" rid="B26">26</xref>], vertical ramus mandibular osteotomy [<xref ref-type="bibr" rid="B27">27</xref>], or single jaw procedure with or without genioplasty [<xref ref-type="bibr" rid="B26">26</xref>,<xref ref-type="bibr" rid="B27">27</xref>]. The sequencing of bimaxillary surgery included maxilla-first approach [<xref ref-type="bibr" rid="B25">25</xref>,<xref ref-type="bibr" rid="B27">27-29</xref>,<xref ref-type="bibr" rid="B31">31</xref>], mandibel-first approach [<xref ref-type="bibr" rid="B25">25</xref>] or the sequence were not reported [<xref ref-type="bibr" rid="B26">26</xref>,<xref ref-type="bibr" rid="B30">30</xref>]. The surgical procedure was performed by the same experienced surgeon [<xref ref-type="bibr" rid="B25">25</xref>,<xref ref-type="bibr" rid="B26">26</xref>,<xref ref-type="bibr" rid="B28">28</xref>,<xref ref-type="bibr" rid="B31">31</xref>], seven surgeons [<xref ref-type="bibr" rid="B27">27</xref>], or an unknown number of surgeons [<xref ref-type="bibr" rid="B29">29</xref>,<xref ref-type="bibr" rid="B30">30</xref>]. TVSP was performed using the treatment planning software Maxilim<sup>&#174;</sup> (Medicim - Nobel Biocare Group; Mechelen, Belgium) [<xref ref-type="bibr" rid="B25">25</xref>], Maxilim (Medicim NV, Mechelen, Belgium) [<xref ref-type="bibr" rid="B26">26</xref>], Simplant<sup>&#174;</sup> Pro version 12.02 OMS (Materialise Corp.; Leuven, Belgium) [<xref ref-type="bibr" rid="B27">27</xref>], Dolphin 3D Imaging<sup>&#174;</sup> (Dolphin Imaging 11.9 Premium and Management Solution<sup>&#174;</sup>; Chatsworth, California, USA) [<xref ref-type="bibr" rid="B28">28</xref>], and Mimics Research version 19.0 or 19.0 (Materialise NV; Leuven, Belgium) [<xref ref-type="bibr" rid="B29">29-31</xref>]. TVSP was conducted using computer-generated surgical splints [<xref ref-type="bibr" rid="B25">25</xref>,<xref ref-type="bibr" rid="B26">26</xref>,<xref ref-type="bibr" rid="B30">30</xref>,<xref ref-type="bibr" rid="B31">31</xref>], computer-generated surgical splints and pre-bent osteosynthesis plates [<xref ref-type="bibr" rid="B28">28</xref>] or computer-generated surgical guides and patient-specific titanium plates for maxillary positioning [<xref ref-type="bibr" rid="B29">29</xref>]. TSP was conducted involving two-dimensional tracing of radiographs, semi- or fully adjustable articulator through facebow transfer of cast model, mock surgery, and manual fabricated acrylic occlusal splints [<xref ref-type="bibr" rid="B25">25-31</xref>]. All measurements were performed by calibrated investigators [<xref ref-type="bibr" rid="B27">27</xref>,<xref ref-type="bibr" rid="B29">29</xref>,<xref ref-type="bibr" rid="B30">30</xref>], while no information was provided about examiner, training, or calibration [<xref ref-type="bibr" rid="B25">25</xref>,<xref ref-type="bibr" rid="B26">26</xref>,<xref ref-type="bibr" rid="B28">28</xref>,<xref ref-type="bibr" rid="B31">31</xref>]. Numbers of dropouts including plausible explanation were reported in two studies [<xref ref-type="bibr" rid="B27">27</xref>,<xref ref-type="bibr" rid="B30">30</xref>].</p>
<p><bold>Data synthesis</bold></p>
<p>The included studies of the present systematic review revealed considerable heterogeneity including use of different software planning system, single jaw surgery or bimaxillary surgery combined with genioplasty, sequencing of the surgical procedure, use of cutting guides and patient-specific osteosynthesis, different outcome measures, and assessment of hard and soft tissue accuracy by dissimilar clinical or radiographic landmarks. A well-defined meta-analysis was therefore not applicable.</p>
<p><bold>Outcome measures</bold></p>
<p>Primary and secondary outcomes measures are presented below and outlined in <xref ref-type="table" rid="T2">Table 2</xref> and <xref ref-type="table" rid="T3">3</xref>. All reported numerical values are presented as mean values combined with standard deviation. For each outcome measure, a short summary is finally provided including concluding remarks. Intraoperative blood loss was not reported in any of the included studies and therefore not described in the following section or outlined in <xref ref-type="table" rid="T2">Table 2</xref> and <xref ref-type="table" rid="T3">3</xref>.</p>

<table-wrap id="T2" position="float">
<label>Table 2</label>
<caption>
<p>
Primary outcome measures following three-dimensional virtual surgical planning compared with two-dimensional surgical planning
</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th  rowspan="3">Study
</th>
<th  rowspan="3">Year of<break />
publication
</th>
<th  colspan="7">Materials and Methods
						  </th>
<th  colspan="6">Primary outcome measures
						  </th>
<th  rowspan="3">Conclusion
</th>
</tr>
<tr>
  <th colspan="7"><hr/></th>
  <th  colspan="6"><hr/></th>
  </tr>
<tr>
<th>P
</th>
<th>Dentofacial deformity
						  </th>
<th>TVSP/<break />
TSP
</th>
<th>Planning instrument 
						  </th>
<th>Surgical procedure
						  </th>
<th>Assessment <break />
methods
</th>
<th>OP
						  </th>
<th  colspan="4">Hard tissue accuracy 
						  </th>
<th  colspan="2">Soft tissue accuracy 
</th>
</tr>
</thead>
<tbody>
<tr>
<td  rowspan="7" align="left">De Riu et al. [25] 
</td>
<td  rowspan="7" align="center">2014
</td>
<td  rowspan="7" align="center">20
</td>
<td  rowspan="7" align="center">Canting of occlusal plane of &gt; 3° or midline discrepancies &gt; 2.5 mm
</td>
<td  rowspan="3" align="center">TVSP: 10
</td>
<td  rowspan="3" align="center">Maxilim
</td>
<td  rowspan="7" align="center">Bimaxillary
</td>
<td  rowspan="7" align="center">Linear and angular measurements define alignment of midlines/cant
</td>
<td  rowspan="7" align="center">IAS
</td>
<td  colspan="4" align="center">Rate of alignment (%) 
</td>
<td  colspan="2" align="center">Rate of alignment (%)
</td>
<td  rowspan="7" align="center">Hard tissue accuracy improved with TVSP</td>
</tr>
<tr>
  <td colspan="4" align="center"><hr/></td>
  <td  colspan="2" align="center"><hr/></td>
</tr>
<tr>
<td align="center">LIPFM
</td>
<td  colspan="2" align="center">MSPFM
</td>
<td align="center">CDM
</td>
<td  colspan="2" align="center">Soft tissue menton/facial midline
</td>
</tr>
<tr>
  <td  rowspan="4" align="center">
    TSP: 10
  </td>
  <td  rowspan="4" align="center">
    Articulator
  </td>
  <td colspan="4" align="center"><hr/></td>
  <td  colspan="2" align="center"><hr/></td>
</tr>
<tr>
<td align="center">88.2<sup>a</sup></td>
<td  colspan="2" align="center">80.2<sup>b</sup></td>
<td align="center">92.6<sup>c</sup>
</td>
<td  colspan="2" align="center">76.7
</td>
</tr>
<tr>
  <td colspan="4" align="center"><hr/></td>
  <td  colspan="2" align="center"><hr/></td>
</tr>
<tr>
<td align="center">50.8
</td>
<td  colspan="2" align="center">42.7
</td>
<td align="center">58.5
</td>
<td  colspan="2" align="center">79.7
</td>
</tr>
<tr>
<td colspan="16"><hr/></td>
</tr>
<tr>
<td  rowspan="7" align="left">Van Hemelen et al. [26]
</td>
<td  rowspan="7" align="center">2015
</td>
<td  rowspan="7" align="center">66
</td>
<td  rowspan="7" align="center">Class II/III
</td>
<td  rowspan="5" align="center">TVSP: 31
</td>
<td  rowspan="5" align="center">Maxilim
</td>
<td  rowspan="5" align="center">Bimaxillay: 20<break />
Single jaw: 11
</td>
<td  rowspan="7" align="center">Linear measurements on cephalometric radiographs
</td>
<td  rowspan="7" align="center">4
</td>
<td  colspan="6" align="center">Difference planned/achieved (mm)
</td>
<td  rowspan="7" align="center">No difference in hard tissue accuracy between TVSP and TSP. Soft tissue accuracy improved with TVSP</td>
</tr>
<tr>
  <td  colspan="6" align="center"><hr/></td>
  </tr>
<tr>
<td  colspan="2" align="center">Horizontal
</td>
<td  colspan="2" align="center">Vertical
</td>
<td align="center">Horizontal
</td>
<td align="center">Vertical
</td>
</tr>
<tr>
  <td  colspan="4" align="center"><hr/></td>
  <td colspan="2" align="center"><hr/></td>
  </tr>
<tr>
<td  colspan="2" align="center">1.42 (SD 0.78)
</td>
<td  colspan="2" align="center">1.44 (SD 0.61)
</td>
<td align="center">1.48 (SD 0.73)<sup>d</sup>
</td>
<td align="center">1.46 (SD 0.53)<sup>e</sup>
</td>
</tr>
<tr>
  <td align="center"><hr/></td>
  <td align="center"><hr/></td>
  <td><hr/></td>
  <td  colspan="2" align="center"><hr/></td>
  <td  colspan="2" align="center"><hr/></td>
  <td align="center"><hr/></td>
  <td align="center"><hr/></td>
</tr>
<tr>
<td align="center">TSP: 35
</td>
<td align="center">Articulator
</td>
<td>Bimaxillay: 26<break />
Single jaw: 9
</td>
<td  colspan="2" align="center">1.71 (SD 0.87)
</td>
<td  colspan="2" align="center">1.69 (SD 0.76)
</td>
<td align="center">2.29 (SD 1.06)
</td>
<td align="center">2.07 (SD 0.95)
</td>
</tr>
<tr>
<td colspan="16"><hr/></td>
</tr>
<tr>
<td  rowspan="7" align="left">Bengtsson et al. [27]
</td>
<td  rowspan="7" align="center">2018
</td>
<td  rowspan="7" align="center">62
</td>
<td  rowspan="7" align="center">Class III and overjet &gt; 5 mm
</td>
<td  rowspan="5" align="center">TVSP: 28
</td>
<td  rowspan="5" align="center">Simplant 
</td>
<td  rowspan="5" align="center">Bimaxillary:15<break />
Single jaw: 13
</td>
<td  rowspan="7" align="center">Linear and angular measurements on cephalometric radiographs
</td>
<td  rowspan="7" align="center">12
</td>
<td  colspan="4" align="center">Difference planned and achieved
</td>
<td  colspan="2" rowspan="7" align="center">NR
</td>
<td  rowspan="7" align="center">Hard tissue accuracy improved with TVSP. TVSP improved outcome in asymmetric facial appearance and malocclusion</td>
</tr>
<tr>
  <td colspan="4" align="center"><hr/></td>
  </tr>
<tr>
<td align="center">First incisor/NSL
</td>
<td  colspan="3" align="center">A-point (mm)
</td>
</tr>
<tr>
  <td align="center"><hr/></td>
  <td  colspan="3" align="center"><hr/></td>
</tr>
<tr>
<td align="center">0.23°<sup>f</sup>
</td>
<td  colspan="3" align="center">1.86<sup>f</sup>
</td>
</tr>
<tr>
  <td align="center"><hr/></td>
  <td align="center"><hr/></td>
  <td><hr/></td>
  <td align="center"><hr/></td>
  <td  colspan="3" align="center"><hr/></td>
</tr>
<tr>
<td align="center">TSP: 29
</td>
<td align="center">Facad
</td>
<td>Bimaxillay:14<break />
Single jaw: 15
</td>
<td align="center">3.95°
</td>
<td  colspan="3" align="center">2.75
</td>
</tr>
<tr>
<td colspan="16"><hr/></td>
</tr>
<tr>
<td  rowspan="7" align="left">Schneider et al. [28]
</td>
<td  rowspan="7" align="center">2019
</td>
<td  rowspan="7" align="center">21
</td>
<td  rowspan="7" align="center">Class II
</td>
<td  rowspan="5" align="center">TVSP: 9
</td>
<td  rowspan="7" align="center">Dolphin
</td>
<td  rowspan="7" align="center">Bimaxillary
</td>
<td  rowspan="7" align="center">SNA, SNB and ANB angle
</td>
<td  rowspan="7" align="center">NR
</td>
<td  colspan="4" align="center">Difference planned and achieved
</td>
<td  colspan="2" rowspan="7" align="center">NR
</td>
<td  rowspan="7" align="center">Hard tissue accuracy was improved with TVSP</td>
</tr>
<tr>
  <td colspan="4" align="center"><hr/></td>
  </tr>
<tr>
<td align="center">SNA
</td>
<td  colspan="2" align="center">SNB
</td>
<td align="center">ANB
</td>
</tr>
<tr>
  <td align="center"><hr/></td>
  <td  colspan="2" align="center"><hr/></td>
  <td align="center"><hr/></td>
</tr>
<tr>
<td align="center">0.6°<sup>h</sup>
</td>
<td  colspan="2" align="center">0.7°<sup>i</sup>
</td>
<td align="center">0.5°<sup>j</sup>
</td>
</tr>
<tr>
  <td><hr/></td>
  <td align="center"><hr/></td>
  <td  colspan="2" align="center"><hr/></td>
  <td align="center"><hr/></td>
</tr>
<tr>
<td>TSP: 12
</td>
<td align="center">1.8°
</td>
<td  colspan="2" align="center">1.9°
</td>
<td align="center">1.6°
</td>
</tr>
<tr>
<td colspan="16"><hr/></td>
</tr>
<tr>
<td  rowspan="7" align="left">Hanafy et al. [29]
</td>
<td  rowspan="7" align="center">2020
</td>
<td  rowspan="7" align="center">18
</td>
<td  rowspan="7" align="center">Dentofacial disharmony and mis-alignment
</td>
<td  rowspan="5" align="center">TVSP: 9
</td>
<td  rowspan="5" align="center">Mimics
</td>
<td  rowspan="7" align="center">Bimaxillary
</td>
<td  rowspan="7" align="center">Linear and angular dental measurements 
</td>
<td  rowspan="7" align="center">IAS
</td>
<td  colspan="4" align="center">Difference planned/achieved (mm)
</td>
<td  colspan="2" rowspan="7" align="center">NR
</td>
<td  rowspan="7" align="center">Hard tissue accuracy was improved with TVSP</td>
</tr>
<tr>
  <td colspan="4" align="center"><hr/></td>
  </tr>
<tr>
<td align="center">Horizontal
</td>
<td  colspan="2" align="center">Vertical
</td>
<td align="center">Transverse
</td>
</tr>
<tr>
  <td align="center"><hr/></td>
  <td  colspan="2" align="center"><hr/></td>
  <td align="center"><hr/></td>
</tr>
<tr>
<td align="center">0.17<sup>k</sup>
</td>
<td  colspan="2" align="center">0.26<sup>k</sup>
</td>
<td align="center">0.07<sup>k</sup>
</td>
</tr>
<tr>
  <td align="center"><hr/></td>
  <td align="center"><hr/></td>
  <td align="center"><hr/></td>
  <td  colspan="2" align="center"><hr/></td>
  <td align="center"><hr/></td>
</tr>
<tr>
<td align="center">TSP: 9
</td>
<td align="center">Articulator
</td>
<td align="center">1.31
</td>
<td  colspan="2" align="center">1.45
</td>
<td align="center">0.71
</td>
</tr>
<tr>
<td colspan="16"><hr/></td>
</tr>
<tr>
<td  rowspan="7" align="left">Xu et al. [30]
</td>
<td  rowspan="7" align="center">2020
</td>
<td  rowspan="7" align="center">30
</td>
<td  rowspan="7" align="center">Class III.
<break />
No severe asymmetry
</td>
<td  rowspan="5" align="center">TVSP: 15
</td>
<td  rowspan="5" align="center">Mimics
</td>
<td  rowspan="7" align="center">Bimaxillary
</td>
<td  rowspan="7" align="center">Maxillary position assessed by three skeletal points
</td>
<td  rowspan="7" align="center">IAS
</td>
<td  colspan="4" align="center">Difference planned/achieved (mm)
</td>
<td  colspan="2" rowspan="7" align="center">NR
</td>
<td  rowspan="7" align="center">No difference in hard tissue accuracy between TVSP and TSP</td>
</tr>
<tr>
  <td colspan="4" align="center"><hr/></td>
  </tr>
<tr>
<td align="center">Horizontal
</td>
<td  colspan="2" align="center">Vertical
</td>
<td align="center">Transverse
</td>
</tr>
<tr>
  <td align="center"><hr/></td>
  <td  colspan="2" align="center"><hr/></td>
  <td align="center"><hr/></td>
</tr>
<tr>
<td align="center">0.89
</td>
<td  colspan="2" align="center">0.77
</td>
<td align="center">0.42
</td>
</tr>
<tr>
  <td align="center"><hr/></td>
  <td align="center"><hr/></td>
  <td align="center"><hr/></td>
  <td  colspan="2" align="center"><hr/></td>
  <td align="center"><hr/></td>
</tr>
<tr>
<td align="center">TSP: 15
</td>
<td align="center">Articulator
</td>
<td align="center">0.95
</td>
<td  colspan="2" align="center">0.69
</td>
<td align="center">0.51
</td>
</tr>
<tr>
<td colspan="16"><hr/></td>
</tr>
<tr>
<td  rowspan="5" align="left">Chen et al. [31]
</td>
<td  rowspan="5" align="center">2021
</td>
<td  rowspan="5" align="center">51
</td>
<td  rowspan="5" align="center">Dentomaxillofacial deformity requiring bimaxillary surgery
</td>
<td  rowspan="3" align="center">TVSP: 21
</td>
<td  rowspan="3" align="center">Mimics
</td>
<td  rowspan="5" align="center">Bimaxillary
</td>
<td  rowspan="5" align="center">Maxillary position assessed by eight selected points on the teeth
</td>
<td  rowspan="5" align="center">7 days after surgery
</td>
<td  colspan="4" align="center">Difference planned/achieved (mm)
</td>
<td  colspan="2" rowspan="5" align="center">NR
</td>
<td  rowspan="5" align="center">No difference in hard tissue accuracy between TVSP and TSP</td>
</tr>
<tr>
  <td  colspan="4" align="center"><hr/></td>
</tr>
<tr>
<td  colspan="4" align="center">2.15 (SD 1.12)
</td>
</tr>
<tr>
  <td align="center"><hr/></td>
  <td align="center"><hr/></td>
  <td  colspan="4" align="center"><hr/></td>
</tr>
<tr>
<td align="center">TSP: 20
</td>
<td align="center">Articulator
</td>
<td  colspan="4" align="center">2.55 (SD 0.95)
</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p><sup>a</sup>P = 0.03 (Student's test); <sup>b</sup>P = 0.01 (Student's test); <sup>c</sup>P = 0.03 (Student's test); <sup>d</sup>P = 0.002 (unpaired Student's t-test); <sup>e</sup>P = 0.005 (unpaired student t-test); <sup>f</sup>P &lt; 0.001 (Fisher's Exact test), <sup>g</sup>P = 0.035 (Fisher's exact test); <sup>h</sup>P &lt; 0.001 (unpaired Student's t-test and Fisher's exact test); <sup>i</sup>P = 0.002 (unpaired Student's t-test and Fisher´s exact test); <sup>j</sup>P &lt; 0.001 (unpaired Student's t-test and Fisher's exact test); <sup>k</sup>P &lt; 0.05 (unpaired Student's t-test, Mann-Whitney U-test).</p>
<p>ANB = A point to B point angle; CDM = centring of the dental midlines; IAS = immediately after surgery; LIPFM = lower interincisal point to facial midline; MSPFM = mandibular sagittal plane to facial midsagittal plane; P = number of patients; SD = standard deviation; SIA = semi-individual articulator; SNA = sella-nasion to A point angle; SNB = sella-nasion to B point angle; TSP = two-dimensional surgical planning; TVSP = three-dimensional virtual surgical planning.</p>
</fn>
</table-wrap-foot>
</table-wrap>

<table-wrap id="T3" position="float">
<label>Table 3</label>
<caption>
<p>
Secondary outcome measures following three-dimensional virtual surgical planning compared with two-dimensional surgical planning
</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th  rowspan="3">Study
</th>
<th  colspan="2">Materials and Methods
</th>
<th  colspan="10">Secondary outcome measures
</th>
<th  rowspan="3">Conclusions
</th>
</tr>
<tr>
  <th colspan="2"><hr/></th>
  <th colspan="10"><hr/></th>
  </tr>
<tr>
<th>TVSP/<break />
TSP
</th>
<th>Assessment <break />
methods
</th>
<th>Treatment planning time<break />
(minutes)
</th>
<th>Operating theatre time<break />
(minutes)
</th>
<th>Complications
</th>
<th>Financial<break />
expenses
</th>
<th  colspan="6">PROMs
</th>
</tr>
</thead>
<tbody>
<tr>
<td  rowspan="5" align="left">Van Hemelen et al. [26]
</td>
<td  rowspan="3" align="center">TVSP: 31
</td>
<td  rowspan="5" align="center">Total time spent on treatment planning.
<break />
Patient appreciation scale questionnaire
</td>
<td  rowspan="3" align="center">38
</td>
<td  rowspan="5" align="center">NR
</td>
<td  rowspan="5" align="center">NR
</td>
<td  rowspan="5" align="center">NR
</td>
<td  colspan="6" align="center">Patient appreciation scale questionnaire
</td>
<td  rowspan="5" align="center">TVSP associated with increased treatment planning time</td>
</tr>
<tr>
<td  colspan="6" align="center"><hr/></td>
</tr>
<tr>
<td  colspan="6" align="center">4.65
</td>
</tr>
<tr>
  <td align="center"><hr/></td>
  <td align="center"><hr/></td>
  <td  colspan="6" align="center"><hr/></td>
</tr>
<tr>
<td align="center">TSP: 35
</td>
<td align="center">20
</td>
<td  colspan="6" align="center">4.67
</td>
</tr>
<tr>
<td colspan="14"><hr/></td>
</tr>
<tr>
<td  rowspan="7" align="left">Bengtsson et al. [27]
</td>
<td  rowspan="5" align="center">TVSP: 28
						  </td>
<td  rowspan="7" align="center">Time for radiographic examination/preparation/planning.
<break />
Financial expenses OHIP-49, JFLS and OES questionnaire
</td>
<td  rowspan="5" align="center">34.1
</td>
<td  rowspan="7" align="center">NR
</td>
<td  rowspan="7" align="center">NR
</td>
<td  rowspan="5" align="center">156.1 $US<sup>a</sup></td>
<td  colspan="2" align="center">OHIP-49
</td>
<td  colspan="2" align="center">JFLS
</td>
<td  colspan="2" align="center">OES
</td>
<td  rowspan="7" align="center">Similar treatment planning time. <break />
TVSP associated with lower financial expenses.
<break />
Comparable improvement PROMs</td>
</tr>
<tr>
  <td colspan="6" align="center"><hr/></td>
  </tr>
<tr>
<td align="center">Pre
</td>
<td align="center">Post
</td>
<td align="center">Pre
</td>
<td align="center">Post
</td>
<td align="center">Pre
</td>
<td align="center">Post
</td>
</tr>
<tr>
  <td colspan="6" align="center"><hr/></td>
  </tr>
<tr>
<td align="center">53.98
</td>
<td align="center">26.67
</td>
<td align="center">33.28
</td>
<td align="center">9.97
</td>
<td align="center">35.07
</td>
<td align="center">59.72
</td>
</tr>
<tr>
  <td align="center"><hr/></td>
  <td align="center"><hr/></td>
  <td colspan="7" align="center"><hr/></td>
</tr>
<tr>
<td align="center">TSP: 29
</td>
<td align="center">32.2
</td>
<td align="center">211.9 $US
</td>
<td align="center">61.26
</td>
<td align="center">37.64
</td>
<td align="center">37.54
</td>
<td align="center">16,03
</td>
<td align="center">38.33
</td>
<td align="center">60.5
</td>
</tr>
<tr>
<td colspan="14"><hr/></td>
</tr>
<tr>
<td  rowspan="3" align="left">Schneider et al. [28]
</td>
<td align="center">TVSP: 9
						  </td>
<td  rowspan="3" align="center">Intraoperative time from start to end.
<break />
Fixed cost including laboratory device
</td>
<td  rowspan="3" align="center">NR
</td>
<td align="center">162 (96 - 215)<sup>b</sup>
</td>
<td  rowspan="3" align="center">NR
</td>
<td align="center">884.0 € 
</td>
<td  colspan="6" rowspan="3" align="center">NR
</td>
<td  rowspan="3" align="center">TVSP associated with shorter intraoperative time.
<break />
TVSP associated with higher cost</td>
</tr>
<tr>
  <td align="center"><hr/></td>
  <td align="center"><hr/></td>
  <td align="center"><hr/></td>
</tr>
<tr>
<td align="center">TSP: 12
</td>
<td align="center">202 (164 - 304)
</td>
<td align="center">481.8 € 
</td>
</tr>
<tr>
<td colspan="14"><hr/></td>
</tr>
<tr>
<td  rowspan="3" align="left">Hanafy et al. [29]
</td>
<td align="center">TVSP: 9
						  </td>
<td  rowspan="3" align="center">Planning related complications.
<break />
Intraoperative time from maxillary incision to fixation 
</td>
<td align="center">113
</td>
<td align="center">49
</td>
<td  rowspan="3" align="center">No planning-related<break />
complications
</td>
<td align="center">780 $US
</td>
<td  colspan="6" rowspan="3" align="center">All patients were satisfied with the<break />
clinical outcome
</td>
<td  rowspan="3" align="center">TVSP associated with shorter treatment planning time and intraoperative time.
<break />
TVSP associated with higher cost
</td>
</tr>
<tr>
  <td align="center"><hr/></td>
  <td align="center"><hr/></td>
  <td align="center"><hr/></td>
  <td align="center"><hr/></td>
</tr>
<tr>
<td align="center">TSP: 9
</td>
<td align="center">192
</td>
<td align="center">72
</td>
<td align="center">280 $US
</td>
</tr>
<tr>
<td colspan="14"><hr/></td>
</tr>
<tr>
<td  rowspan="3" align="left">Chen et al. [31]
</td>
<td align="center">TVSP: 21
						  </td>
<td  rowspan="3" align="center">Duration of the operation from Le Fort I osteotomy to maxilla fixation 
</td>
<td  rowspan="3" align="center">NR
</td>
<td align="center">39.1 (SD 15)
</td>
<td  rowspan="3" align="center">NR
</td>
<td  rowspan="3" align="center">NR
</td>
<td  colspan="6" rowspan="3" align="center">NR
</td>
<td  rowspan="3" align="center">No difference in intraoperative time
</td>
</tr>
<tr>
  <td align="center"><hr/></td>
  <td align="center"><hr/></td>
</tr>
<tr>
<td align="center">TSP: 20
</td>
<td align="center">41.7 (SD 13.1)
</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>
<sup>a</sup>P &lt; 0.001 (Fisher's exact test); <sup>b</sup>P = 0.041 (unpaired Student's t-test and Fisher's exact test).
</p>
<p>
JFLS = jaw functional limitation scale; NR = not reported; OES = orofacial aesthetic scale; OHIP = oral health impact profile; OHRQOL = oral health-related quality of life; PROMs = patient-reported outcome measures; SD = standard deviation; TSP = two-dimensional surgical planning; TVSP = three-dimensional virtual surgical planning.
</p>
</fn>
</table-wrap-foot>
</table-wrap>

<p><bold>Primary outcome measures</bold></p>
<p><bold><italic>Hard tissue accuracy</italic></bold></p>
<p>Hard tissue accuracy was compared in all the included studies [<xref ref-type="bibr" rid="B25">25-31</xref>]. Results from each of the included studies are presented below in numerical order [<xref ref-type="bibr" rid="B25">25-31</xref>].</p>
<p>The percentage of linear and angular alignment of selected anatomical landmarks were assessed in patients with facial asymmetries [<xref ref-type="bibr" rid="B25">25</xref>]. TVSP revealed a statistically significantly improvement in alignment of the lower interincisal point (P = 0.03), mandibular sagittal plane (P = 0.01), and centring of the dental midlines (P = 0.03) compared with TSP [<xref ref-type="bibr" rid="B25">25</xref>].</p>
<p>The differences between the achieved surgical outcome and planned position were analysed using cephalometric landmarks in another study [<xref ref-type="bibr" rid="B26">26</xref>]. Difference in the anteriorposterior and vertical dimension were 1.42 and 1.44 mm with TVSP. Corresponding measurements were 1.71 mm and 1.69 mm for TSP. There were no statistically significant differences between TVSP and TSP [<xref ref-type="bibr" rid="B26">26</xref>]. </p>
<p>The differences between the achieved surgical outcome and planned position were analysed using superimposition of cephalometric landmarks, after 12 months [<xref ref-type="bibr" rid="B27">27</xref>]. TVSP and TSP disclosed comparable outcomes in the anteriorposterior dimension for most of the cephalometric landmarks. Difference in A point position was 1.86 mm and 2.75 mm with TVSP and TSP. The difference was statistically significant (P = 0.035). Difference in the axis of the upper incisor and the nasion-sella line was 0.23 degrees and 3.95 degrees with TVSP and TSP. The difference was statistically significant (P &lt; 0.001) [<xref ref-type="bibr" rid="B27">27</xref>]. </p>
<p>The differences between the achieved surgical outcome and planned position were analysed using angular measurements including sella-nasion to A point (SNA), sella-nasion to B point (SNB), and A point to B point (ANB) [<xref ref-type="bibr" rid="B28">28</xref>]. Differences in the anteriorposterior dimension using TVSP were 0.6 degrees (SNA), 0.7 degrees (SND), and 0.5 degrees (ANB). Corresponding measurements for TSP were 1.8 degrees (SNA), 1.9 degrees (SND), and 1.6 degrees (ANB). The difference was statistically significant at SNA (P &lt; 0.001), SNB (P = 0.002), and ANB (P &lt; 0.001) [<xref ref-type="bibr" rid="B28">28</xref>]. </p>
<p>The differences between the achieved surgical outcome and planned position were analysed using dental reference points and angular deviation of the dental occlusion and maxilla [<xref ref-type="bibr" rid="B29">29</xref>]. Difference in the anteriorposterior, vertically, and mediolaterally dimension were 0.17 mm, 0.26 mm, and 0.07 mm with TVSP. Corresponding measurements were 1.31 mm, 1.45 mm, and 0.71 mm for TSP. The differences were statistically significant (P &lt; 0.05) [<xref ref-type="bibr" rid="B29">29</xref>].</p>
<p>The differences between the achieved surgical outcome and planned position were analysed using linear measurements on skeletal landmarks including subspinale and the last midpoint on the hard palate [<xref ref-type="bibr" rid="B30">30</xref>]. Differences in the horizontal, vertical, and transverse dimension using TVSP were 0.95 mm, 0.69 mm, and 0.51 mm, respectively. Corresponding measurements for TSP were 0.89 mm, 0.77 mm, and 0.42 mm, respectively. There were no statistically significant differences between TVSP and TSP [<xref ref-type="bibr" rid="B30">30</xref>]. </p>
<p>The differences between the achieved surgical outcome and planned position were analysed using linear measurements on eight selected points on the surface of the maxillary teeth [<xref ref-type="bibr" rid="B31">31</xref>]. The difference was 2.15 (SD 1.12) mm using TVSP compared with 2.55 (SD 0.95) mm with TSP. There were no statistically significant differences between TVSP and TSP (P &lt; 0.05) [<xref ref-type="bibr" rid="B31">31</xref>]. </p>
<p><bold>Summary</bold></p>
<p>The hard tissue accuracy following orthognathic surgical planning using TVSP compared with TSP is inconsistent. However, various studies revealed a statistically significant improvement in hard tissue accuracy with TVSP compared with TSP. Thus, TVSP seems to beneficially improve the hard tissue accuracy between the planned position and the achieved surgical outcome compared with TSP.</p>
<p><bold><italic>Soft tissue accuracy</italic></bold></p>
<p>Soft tissue accuracy was compared in two studies [<xref ref-type="bibr" rid="B25">25</xref>,<xref ref-type="bibr" rid="B26">26</xref>].</p>
<p>There was no statistically significant difference in the percentage rate of alignment of the soft tissue menton to the facial midline between TVSP and TSP (P = 1.00) [<xref ref-type="bibr" rid="B25">25</xref>]. </p>
<p>Differences between the achieved surgical outcome and planned position were analysed using cephalometric landmarks [<xref ref-type="bibr" rid="B26">26</xref>]. Difference in the anteriorposterior and vertical dimension were 1.48 and 1.46 mm using TVSP. Corresponding measurements were 2.29 mm and 2.07 mm for TSP. The differences were statistically significant (P = 0.002, P = 0.005) [<xref ref-type="bibr" rid="B26">26</xref>]. </p>
<p><bold>Summary</bold></p>
<p>The soft tissue accuracy following orthognathic surgical planning using TVSP compared with TSP is inconsistent. However, TVSP seems to beneficially improve the soft tissue accuracy between the planned position and the achieved surgical outcome compared with TSP. </p>
<p><bold>Secondary outcome measures</bold></p>
<p><bold><italic>Treatment planning time</italic></bold></p>
<p>The required treatment planning time was compared in two studies [<xref ref-type="bibr" rid="B26">26</xref>,<xref ref-type="bibr" rid="B29">29</xref>].</p>
<p>The treatment planning time was 38 minutes using TVSP, while 20 minutes were used for TSP [<xref ref-type="bibr" rid="B26">26</xref>]. The used method for assessment of treatment planning time was not specified and no statistical method was applied [<xref ref-type="bibr" rid="B26">26</xref>].</p>
<p>The treatment planning time from the end of the virtual plan to stereolithography (STL) export was 113 minutes using TVSP, while 192 minutes were used for TSP [<xref ref-type="bibr" rid="B29">29</xref>]. No statistical method was applied [<xref ref-type="bibr" rid="B29">29</xref>].</p>
<p><bold>Summary</bold></p>
<p>The required treatment planning time for orthognathic surgical planning with TVSP and TSP is inconsistent. </p>
<p><bold><italic>Time in the operating theatre</italic></bold></p>
<p>Time in the operating theatre was compared in three studies [<xref ref-type="bibr" rid="B28">28</xref>,<xref ref-type="bibr" rid="B29">29</xref>,<xref ref-type="bibr" rid="B31">31</xref>].</p>
<p>The intraoperative time from the start to the end of the operation was 162 minutes (range: 96 to 215 minutes) using TVSP and pre-bent osteosynthesis plates compared with 202 minutes (range: 164 to 304) for TSP. The difference was statistically significant (P = 0.041) [<xref ref-type="bibr" rid="B28">28</xref>].</p>
<p>The intraoperative time from maxillary incision to fixation was 49 minutes using TVSP with cutting guides and patient-specific osteosynthesis, while 72 minutes were used for TSP and conventional osteosynthesis [<xref ref-type="bibr" rid="B29">29</xref>]. No statistical method was applied [<xref ref-type="bibr" rid="B29">29</xref>].</p>
<p>The intraoperative time from Le Fort I osteotomy, placement of intermediate splint, and maxilla fixation was recorded using a stopwatch [<xref ref-type="bibr" rid="B31">31</xref>]. The recorded time was 39.1 (SD 15) minutes for TVSP and 41.7 (SD 13.1) minutes for TSP, respectively. The difference was not statistically significant (P &gt; 0.05) [<xref ref-type="bibr" rid="B31">31</xref>]. </p>
<p><bold>Summary</bold></p>
<p>TVSP seems to shorten the required time in the operating theatre compared with TSP. </p>
<p><bold>Complications</bold></p>
<p>Complications related to preparation, transmission, and implementations of the treatment plan were compared in one study [<xref ref-type="bibr" rid="B29">29</xref>].</p>
<p>No planning-related complications were reported following orthognathic surgical planning using TVSP and TSP [<xref ref-type="bibr" rid="B29">29</xref>].</p>
<p><bold>Summary</bold></p>
<p>TVSP and TSP seems to be associated with no surgical planning-related complications.</p>
<p><bold>Financial expenses</bold></p>
<p>Financial expenses were compared in three studies [<xref ref-type="bibr" rid="B27">27-29</xref>].</p>
<p>Financial expenses for radiographic examination, purchase of software, and annually software licence combined with time calculated cost following orthognathic surgical planning using TVSP or TSP were 211.88$ (US dollars) and 156.12$, respectively [<xref ref-type="bibr" rid="B27">27</xref>]. The difference was statistically significant (P = 0.041) [<xref ref-type="bibr" rid="B27">27</xref>].</p>
<p>Financial expenses following orthognathic surgical planning using TVSP or TSP was 884€ (Euros) and 481.8€, respectively [<xref ref-type="bibr" rid="B28">28</xref>]. However, the cost of TVSP was reduced to 479.0€ without osteotomy models. No statistical method was applied [<xref ref-type="bibr" rid="B28">28</xref>].</p>
<p>Financial expenses for patient-specific cutting guides and plates were approximately 780$ compared with 280$ for conventional plates [<xref ref-type="bibr" rid="B29">29</xref>]. No statistical method was applied [<xref ref-type="bibr" rid="B29">29</xref>].</p>
<p><bold>Summary</bold></p>
<p>TVSP increases the financial expenses following orthognathic surgical planning compared with TSP. Moreover, the use of cutting guides and patient-specific osteosynthesis plates in conjunction with TVSP further increases the financial expenses compared with TSP using conventional plate osteosynthesis.</p>
<p><bold>Patient-reported outcome measures</bold></p>
<p>PROMs were compared in three studies [<xref ref-type="bibr" rid="B26">26</xref>,<xref ref-type="bibr" rid="B27">27</xref>,<xref ref-type="bibr" rid="B29">29</xref>].</p>
<p>Patient appreciation scale revealed good satisfaction following orthognathic surgical planning with TVSP (4.65) and TSP (4.67), after four months [<xref ref-type="bibr" rid="B26">26</xref>]. No statistical method was applied [<xref ref-type="bibr" rid="B26">26</xref>].</p>
<p>OHRQoL was assessed by Oral Health Impact Profile 49 (OHIP-49), Jaw Functional Limitation Scale (JFL), and Orofacial Esthetic questionnaire (OES) following orthognathic surgical planning with TVSP and TSP [<xref ref-type="bibr" rid="B27">27</xref>]. A significant improvement in OHRQoL was reported with both treatment planning techniques. There was no statistically significant difference in total OHIP-49 score (P = 0.65), JFL score (P = 0.83), and OES score (P = 0.64) following orthognathic surgical planning with TVSP and TSP, after 12 months [<xref ref-type="bibr" rid="B27">27</xref>].</p>
<p>High patient satisfaction with the clinical outcome were reported with TVSP and TSP, after four months [<xref ref-type="bibr" rid="B29">29</xref>]. The applied method for assessment of PROMs were not described [<xref ref-type="bibr" rid="B29">29</xref>]. </p>
<p><bold><italic>Summary</italic></bold></p>
<p>Comparable patient satisfaction and improvement in OHRQoL were reported following orthognathic surgical planning with TVSP and TSP. </p>
</sec>

<sec sec-type="discussion">
<title>DISCUSSION</title>
<p>The primary objective of the present systematic review was to assess the predictability and accuracy of orthognathic surgical planning using TVSP techniques compared with TSP. Seven randomized controlled trial characterized by various risk of bias as well as high or low grade fulfilled the inclusion criteria [<xref ref-type="bibr" rid="B25">25-31</xref>]. The hard and soft tissue accuracy between the planned position and achieved surgical outcome seems to be beneficially improved by TVSP compared with TSP, although the results of the included studies are inconsistent. The reported required treatment planning time with TVSP and TSP was opposing, while the intraoperative time was shortened, and the financial expenses were increased with TVSP. No planning-related complications were reported with TVSP and TSP. Comparable patient satisfaction and improvement in OHRQoL were revealed with TVSP and TSP. The included studies of the present systematic review revealed conflicting results according to the primary and secondary outcome measures. Synthesising inconsistent outcomes in reliable clinical recommendations attributes several limitations. Conclusions provided from the results of the present systematic review is therefore supplemented by the authors’ considerations and should be cautiously interpreted.</p>
<p>Systematic reviews summarize and analyse the current scientific knowledge within a specific topic to answer a well-defined research question. Systematic reviews based on randomized controlled trials are generally considered as the highest quality evidence for assessing the effectiveness of a particular intervention due to an unbiased study design and diminished risk of systematic errors. Systematic reviews are frequently combined with a meta-analysis, which is a statistic method that combines data from several comparable studies into a single quantitative estimate or summary effect size. The present systematic review tried to answer the research question, whether TVSP led to improved predictability and accuracy of orthognathic surgical planning compared with TSP based on randomized controlled trials. However, severe methodological heterogeneity, dissimilar risk of bias, and various confounding factors prevented application of well-defined meta-analyses. Conclusion of the present systematic review is therefore based on descriptive data leading to the conclusion that none of the used orthognathic surgical planning techniques could be considered better than the other. Further well-conducted randomized controlled trials including comparable clinical and radiographic assessments methods, observation periods, and uniform data presentation are therefore needed to answer the focus question of the present systematic review. </p>
<p>Preoperative planning of orthognathic surgery has evolved substantially during the last decade from two-dimensional analysis on lateral cephalograms combined with manual model surgery and manufacturing of acrylic splints towards three-dimensional computer-assisted techniques using high-resolution CT or CBCT scans and computer software [<xref ref-type="bibr" rid="B42">42</xref>]. These novel treatment planning options poses new possibilities in orthognathic surgery including virtual surgeries, computer-generated surgical splints, cutting guides and patient-specific osteosynthesis, which is anticipated to improve the predictability and accuracy of the treatment plan and the actual surgical outcome [<xref ref-type="bibr" rid="B6">6</xref>]. However, the improved predictability and accuracy of TVSP compared with TSP have been questioned [<xref ref-type="bibr" rid="B32">32</xref>]. Moreover, a recent systematic review concluded that the scientific literature lacks consensus regarding the accuracy of TVSP following orthognathic surgery [<xref ref-type="bibr" rid="B7">7</xref>]. From the author’s point of view, it is indisputable that future orthognathic surgical planning will be performed by TVSP and computer-generated surgical splints possibly combined with cutting guides and patient-specific osteosynthesis. Moreover, detailed analysis and planning of facial asymmetries in patients with severe dentofacial asymmetries and occlusal canting is significantly enhanced by using TVSP compared with TSP. The focus question of improved predictability and accuracy of orthognathic surgical planning between TVSP and TSP therefore seems immaterial since TVSP has proven comparable or enhanced accuracy without significantly prolonging the required treatment planning time, intraoperative time or increased the financial expenses substantially. Further development of the TVSP technique to improve the transmission accuracy and implementation of the treatment plan to the surgical setting is therefore today´s challenge. </p>
<p>A difference of maximum 2 mm between the treatment plan and the actual surgical outcome is generally considered as a success criterion following orthognathic surgery [<xref ref-type="bibr" rid="B6">6</xref>]. Most of the included studies of the present systematic review revealed less than 2 mm discrepancy between the treatment plan and the actual surgical outcome with TVSP and TSP [<xref ref-type="bibr" rid="B26">26</xref>,<xref ref-type="bibr" rid="B29">29</xref>,<xref ref-type="bibr" rid="B30">30</xref>], whereas more than 2 mm discrepancy was reported with TSP [<xref ref-type="bibr" rid="B27">27</xref>], or both treatment planning techniques [<xref ref-type="bibr" rid="B31">31</xref>]. The surgical accuracy of positioning the maxilla following TVSP with the use of cutting guides and patient-specific osteosynthesis have been assessed in various studies demonstrating a mean difference less than 1 mm between the treatment plan and the actual surgical outcome [<xref ref-type="bibr" rid="B43">43-45</xref>]. Moreover, a resent systematic review reported that the required treatment planning and intraoperative time were shortened by approximately one third following TVSP involving cutting guides and patient-specific osteosynthesis compared with TSP and conventional plate osteosynthesis [<xref ref-type="bibr" rid="B46">46</xref>]. Consequently, TVSP with the use of cutting guides and patient-specific osteosynthesis seems to beneficially improve the predictability and accuracy of orthognathic surgical planning.</p>
<p>A recent published systematic review concluded that the financial expenses were significantly increased following orthognathic surgical planning using TVSP, cutting guides, and patient-specific osteosynthesis compared with TSP and conventional plate osteosynthesis [<xref ref-type="bibr" rid="B46">46</xref>]. The higher financial expenses may possibly restrict routine use of TVSP in orthognathic surgery. However, shortening of the required treatment planning time, operating theatre time, and hospitalization could justify the additional financial expenses following TVSP with the use of cutting guides and patient-specific osteosynthesis. Moreover, further development of software programs for orthognathic surgical planning will probably decreases the financial expenses associated with TVSP. In addition, a newly published study reported a higher incidence of reoperations following Le Fort I osteotomy with conventional plate osteosynthesis compared with patient-specific osteosynthesis due to insufficient advancement or postsurgical malocclusion [<xref ref-type="bibr" rid="B47">47</xref>]. Consequently, reliable comparison of financial expenses following orthognathic surgical planning using TVSP, cutting guides and patient-specific osteosynthesis compared with TSP and conventional plate osteosynthesis is multifaceted and various aspects such as frequency of reoperations, time savings, and length of hospitalization should be included in future studies assessing financial expenses following orthognathic surgery.</p>
<p>A recent published systematic review concluded that orthognathic surgery generates a positive impact on OHRQoL [<xref ref-type="bibr" rid="B1">1</xref>]. Improved satisfaction with facial appearance, masticatory function, and postsurgical OHRQoL are important considerations for orthognathic surgery patients. PROMs using self-administrated questionnaires, interviews or visual analogue scale are therefore valuable tools to evaluate whether health care services or a surgical intervention improve patients’ health status or OHRQoL, including symptoms and functionality as well as physical, mental, and social health. The included studies of the present systematic review reported comparable improvement in OHRQoL following orthognathic surgical planning with TVSP and TSP [<xref ref-type="bibr" rid="B26">26</xref>,<xref ref-type="bibr" rid="B27">27</xref>,<xref ref-type="bibr" rid="B29">29</xref>]. However, PROMs were assessed by few questionnaires [<xref ref-type="bibr" rid="B26">26</xref>,<xref ref-type="bibr" rid="B27">27</xref>] or reported as a statement that all patients were satisfied with the clinical outcome [<xref ref-type="bibr" rid="B29">29</xref>]. Consequently, further studies assessing PROMs following orthognathic surgery with TVSP or TSP are needed.</p>
</sec>

<sec sec-type="conclusions">
<title>CONCLUSIONS</title>
<p>The predictability and accuracy of orthognathic surgical planning using three-dimensional virtual surgical planning techniques compared with conventional two-dimensional surgical planning was assessed in the present systematic review. The included studies disclosed conflicting results regarding accuracy of hard and soft tissue as well as required treatment planning time. The intraoperative time was shortened, and the financial expenses were increased with three-dimensional virtual surgical planning, while no planning-related complications and comparable improvement in oral health-related quality of life were reported with the two treatment planning techniques. Synthesising inconsistent outcomes in reliable clinical recommendations attributes several limitations. Nevertheless, it seems that the hard and soft tissue accuracy between the planned position and achieved surgical outcome are improved by three-dimensional virtual surgical planning, although the results are inconsistent. However, from the authors’ point of view, it is indisputable that future planning of orthognathic surgery will be performed by three-dimensional virtual surgical planning techniques. The increased financial expenses, treatment planning time, and intraoperative time following orthognathic surgical planning with three-dimensional virtual surgical planning will probably be reduced due to further software development. Moreover, further development of three-dimensional virtual surgical planning techniques involving cutting guides and patient-specific osteosynthesis plates will probably improve the accuracy of orthognathic surgical planning, especially in patients with severe facial asymmetries and occlusal canting. However, theses aspects must be assessed in future studies. </p>
</sec>
</body>

<back>

<app-group>
<app id="app1">
<title>APPENDIX 1</title>
<p>Adobe PDF File</p>
<media mimetype="application" mime-subtype="pdf" xlink:href="jomr-14-e1-a001.pdf"/>
</app>
<app id="app2">
<title>APPENDIX 2</title>
<p>Adobe PDF File</p>
<media mimetype="application" mime-subtype="pdf" xlink:href="jomr-14-e1-a002.pdf"/>
</app>
<app id="app3">
<title>APPENDIX 3</title>
<p>Adobe PDF File</p>
<media mimetype="application" mime-subtype="pdf" xlink:href="jomr-14-e1-a003.pdf"/>
</app>
<app id="app4">
<title>APPENDIX 4</title>
<p>Adobe PDF File</p>
<media mimetype="application" mime-subtype="pdf" xlink:href="jomr-14-e1-a004.pdf"/>
</app>
</app-group>
<ack>
<sec sec-type="acknowledgments and disclosure statements">
<title>ACKNOWLEDGMENTS AND DISCLOSURE STATEMENTS</title>
<p>The authors declare that there are no financial or other conflicts of interest related to this publication. The authors would like to give a special thanks to Ms. Pernille Skou Gaardsted (Medical Library, Aalborg University Hospital, Aalborg, Denmark) for her assistance with the search strategy. There were no sources of funding for this systematic review.</p>
</sec>
</ack>

<ref-list>
<title>REFERENCES</title>
    <ref id="B1"><label>1</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Meger</surname>
<given-names>MN</given-names>
</name><name>
<surname>Fatturi</surname>
<given-names>AL</given-names>
</name><name>
<surname>Gerber</surname>
<given-names>JT</given-names>
</name><name>
<surname>Weiss</surname>
<given-names>SG</given-names>
</name><name>
<surname>Rocha</surname>
<given-names>JS</given-names>
</name><name>
<surname>Scariot</surname>
<given-names>R</given-names>
</name><name>
<surname>Wambier</surname>
<given-names>LM</given-names>
</name>
</person-group>
<source>Impact of orthognathic surgery on quality of life of patients with dentofacial deformity: a systematic review and meta-analysis. Br J Oral Maxillofac Surg. 2021 Apr;59(3):265-271.</source>
<pub-id pub-id-type="pmid">33546846</pub-id>
<pub-id pub-id-type="doi">10.1016/j.bjoms.2020.08.014</pub-id>
</element-citation>
    </ref>
    <ref id="B2"><label>2</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Sun</surname>
<given-names>H</given-names>
</name><name>
<surname>Shang</surname>
<given-names>HT</given-names>
</name><name>
<surname>He</surname>
<given-names>LS</given-names>
</name><name>
<surname>Ding</surname>
<given-names>MC</given-names>
</name><name>
<surname>Su</surname>
<given-names>ZP</given-names>
</name><name>
<surname>Shi</surname>
<given-names>YL</given-names>
</name>
</person-group>
<source>Assessing the Quality of Life in Patients With Dentofacial Deformities Before and After Orthognathic Surgery. J Oral Maxillofac Surg. 2018 Oct;76(10):2192-2201.</source>
<pub-id pub-id-type="pmid">29684310</pub-id>
<pub-id pub-id-type="doi">10.1016/j.joms.2018.03.026</pub-id>
</element-citation>
    </ref>
    <ref id="B3"><label>3</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>de Araujo</surname>
<given-names>CM</given-names>
</name><name>
<surname>Schroder</surname>
<given-names>AGD</given-names>
</name><name>
<surname>de Araujo</surname>
<given-names>BMM</given-names>
</name><name>
<surname>Cavalcante-Leão</surname>
<given-names>BL</given-names>
</name><name>
<surname>Stechman-Neto</surname>
<given-names>J</given-names>
</name><name>
<surname>Zeigelboim</surname>
<given-names>BS</given-names>
</name><name>
<surname>Santos</surname>
<given-names>RS</given-names>
</name><name>
<surname>Guariza-Filho</surname>
<given-names>O</given-names>
</name>
</person-group>
<source>Impact of orthodontic-surgical treatment on quality of life: a meta-analysis. Eur J Orthod. 2020 Jun 23;42(3):281-289.</source>
<pub-id pub-id-type="pmid">31784741</pub-id>
<pub-id pub-id-type="doi">10.1093/ejo/cjz093</pub-id>
</element-citation>
    </ref>
    <ref id="B4"><label>4</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Giralt-Hernando</surname>
<given-names>M</given-names>
</name><name>
<surname>Valls-Ontañón</surname>
<given-names>A</given-names>
</name><name>
<surname>Guijarro-Martínez</surname>
<given-names>R</given-names>
</name><name>
<surname>Masià-Gridilla</surname>
<given-names>J</given-names>
</name><name>
<surname>Hernández-Alfaro</surname>
<given-names>F</given-names>
</name>
</person-group>
<source>Impact of surgical maxillomandibular advancement upon pharyngeal airway volume and the apnoea-hypopnoea index in the treatment of obstructive sleep apnoea: systematic review and meta-analysis. BMJ Open Respir Res. 2019 Oct 9;6(1):e000402.</source>
<pub-id pub-id-type="pmid">31673361</pub-id>
<pub-id pub-id-type="pmcid">PMC 6797338</pub-id>
<pub-id pub-id-type="doi">10.1136/bmjresp-2019-000402</pub-id>
</element-citation>
    </ref>
    <ref id="B5"><label>5</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Islam</surname>
<given-names>I</given-names>
</name><name>
<surname>Lim</surname>
<given-names>AAT</given-names>
</name><name>
<surname>Wong</surname>
<given-names>RCW</given-names>
</name>
</person-group>
<source>Changes in bite force after orthognathic surgical correction of mandibular prognathism: a systematic review. Int J Oral Maxillofac Surg. 2017 Jun;46(6):746-755.</source>
<pub-id pub-id-type="pmid">28209396</pub-id>
<pub-id pub-id-type="doi">10.1016/j.ijom.2017.01.012</pub-id>
</element-citation>
    </ref>
    <ref id="B6"><label>6</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Stokbro</surname>
<given-names>K</given-names>
</name><name>
<surname>Aagaard</surname>
<given-names>E</given-names>
</name><name>
<surname>Torkov</surname>
<given-names>P</given-names>
</name><name>
<surname>Bell</surname>
<given-names>RB</given-names>
</name><name>
<surname>Thygesen</surname>
<given-names>T</given-names>
</name>
</person-group>
<source>Virtual planning in orthognathic surgery. Int J Oral Maxillofac Surg. 2014 Aug;43(8):957-65.</source>
<pub-id pub-id-type="pmid">24746388</pub-id>
<pub-id pub-id-type="doi">10.1016/j.ijom.2014.03.011</pub-id>
</element-citation>
    </ref>
    <ref id="B7"><label>7</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Gaber</surname>
<given-names>RM</given-names>
</name><name>
<surname>Shaheen</surname>
<given-names>E</given-names>
</name><name>
<surname>Falter</surname>
<given-names>B</given-names>
</name><name>
<surname>Araya</surname>
<given-names>S</given-names>
</name><name>
<surname>Politis</surname>
<given-names>C</given-names>
</name><name>
<surname>Swennen</surname>
<given-names>GRJ</given-names>
</name><name>
<surname>Jacobs</surname>
<given-names>R</given-names>
</name>
</person-group>
<source>A Systematic Review to Uncover a Universal Protocol for Accuracy Assessment of 3-Dimensional Virtually Planned Orthognathic Surgery. J Oral Maxillofac Surg. 2017 Nov;75(11):2430-2440.</source>
<pub-id pub-id-type="pmid">28646644</pub-id>
<pub-id pub-id-type="doi">10.1016/j.joms.2017.05.025</pub-id>
</element-citation>
    </ref>
    <ref id="B8"><label>8</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Van den Bempt</surname>
<given-names>M</given-names>
</name><name>
<surname>Liebregts</surname>
<given-names>J</given-names>
</name><name>
<surname>Maal</surname>
<given-names>T</given-names>
</name><name>
<surname>Bergé</surname>
<given-names>S</given-names>
</name><name>
<surname>Xi</surname>
<given-names>T</given-names>
</name>
</person-group>
<source>Toward a higher accuracy in orthognathic surgery by using intraoperative computer navigation, 3D surgical guides, and/or customized osteosynthesis plates: A systematic review. J Craniomaxillofac Surg. 2018 Dec;46(12):2108-2119.</source>
<pub-id pub-id-type="pmid">30420150</pub-id>
<pub-id pub-id-type="doi">10.1016/j.jcms.2018.10.012</pub-id>
</element-citation>
    </ref>
    <ref id="B9"><label>9</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Sharifi</surname>
<given-names>A</given-names>
</name><name>
<surname>Jones</surname>
<given-names>R</given-names>
</name><name>
<surname>Ayoub</surname>
<given-names>A</given-names>
</name><name>
<surname>Moos</surname>
<given-names>K</given-names>
</name><name>
<surname>Walker</surname>
<given-names>F</given-names>
</name><name>
<surname>Khambay</surname>
<given-names>B</given-names>
</name><name>
<surname>McHugh</surname>
<given-names>S</given-names>
</name>
</person-group>
<source>How accurate is model planning for orthognathic surgery? Int J Oral Maxillofac Surg. 2008 Dec;37(12):1089-93.</source>
<pub-id pub-id-type="pmid">18760569</pub-id>
<pub-id pub-id-type="doi">10.1016/j.ijom.2008.06.011</pub-id>
</element-citation>
    </ref>
    <ref id="B10"><label>10</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Rustemeyer</surname>
<given-names>J</given-names>
</name><name>
<surname>Groddeck</surname>
<given-names>A</given-names>
</name><name>
<surname>Zwerger</surname>
<given-names>S</given-names>
</name><name>
<surname>Bremerich</surname>
<given-names>A</given-names>
</name>
</person-group>
<source>The accuracy of two-dimensional planning for routine orthognathic surgery. Br J Oral Maxillofac Surg. 2010 Jun;48(4):271-5.</source>
<pub-id pub-id-type="pmid">19632014</pub-id>
<pub-id pub-id-type="doi">10.1016/j.bjoms.2009.06.018</pub-id>
</element-citation>
    </ref>
    <ref id="B11"><label>11</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Tondin</surname>
<given-names>GM</given-names>
</name><name>
<surname>Leal</surname>
<given-names>MOCD</given-names>
</name><name>
<surname>Costa</surname>
<given-names>ST</given-names>
</name><name>
<surname>Grillo</surname>
<given-names>R</given-names>
</name><name>
<surname>Jodas</surname>
<given-names>CRP</given-names>
</name><name>
<surname>Teixeira</surname>
<given-names>RG</given-names>
</name>
</person-group>
<source>Evaluation of the accuracy of virtual planning in bimaxillary orthognathic surgery: a systematic review. Br J Oral Maxillofac Surg. 2022 May;60(4):412-421.</source>
<pub-id pub-id-type="pmid">35120785</pub-id>
<pub-id pub-id-type="doi">10.1016/j.bjoms.2021.09.010</pub-id>
</element-citation>
    </ref>
    <ref id="B12"><label>12</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Alkhayer</surname>
<given-names>A</given-names>
</name><name>
<surname>Piffkó</surname>
<given-names>J</given-names>
</name><name>
<surname>Lippold</surname>
<given-names>C</given-names>
</name><name>
<surname>Segatto</surname>
<given-names>E</given-names>
</name>
</person-group>
<source>Accuracy of virtual planning in orthognathic surgery: a systematic review. Head Face Med. 2020 Dec 4;16(1):34.</source>
<pub-id pub-id-type="pmid">33272289</pub-id>
<pub-id pub-id-type="pmcid">PMC 7716456</pub-id>
<pub-id pub-id-type="doi">10.1186/s13005-020-00250-2</pub-id>
</element-citation>
    </ref>
    <ref id="B13"><label>13</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Chen</surname>
<given-names>Z</given-names>
</name><name>
<surname>Mo</surname>
<given-names>S</given-names>
</name><name>
<surname>Fan</surname>
<given-names>X</given-names>
</name><name>
<surname>You</surname>
<given-names>Y</given-names>
</name><name>
<surname>Ye</surname>
<given-names>G</given-names>
</name><name>
<surname>Zhou</surname>
<given-names>N</given-names>
</name>
</person-group>
<source>A Meta-analysis and Systematic Review Comparing the Effectiveness of Traditional and Virtual Surgical Planning for Orthognathic Surgery: Based on Randomized Clinical Trials. J Oral Maxillofac Surg. 2021 Feb;79(2):471.e1-471.e19.</source>
<pub-id pub-id-type="pmid">33031773</pub-id>
<pub-id pub-id-type="doi">10.1016/j.joms.2020.09.005</pub-id>
</element-citation>
    </ref>
    <ref id="B14"><label>14</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Philip</surname>
<given-names>MR</given-names>
</name><name>
<surname>AlFotawi</surname>
<given-names>R</given-names>
</name>
</person-group>
<source>The accuracy of soft tissue movement using virtual planning for non-syndromic facial asymmetry cases-a systematic review. Oral Maxillofac Surg. 2022 Apr 18.</source>
<pub-id pub-id-type="pmid">35434758</pub-id>
<pub-id pub-id-type="doi">10.1007/s10006-022-01059-w</pub-id>
</element-citation>
    </ref>
    <ref id="B15"><label>15</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Alkaabi</surname>
<given-names>S</given-names>
</name><name>
<surname>Maningky</surname>
<given-names>M</given-names>
</name><name>
<surname>Helder</surname>
<given-names>MN</given-names>
</name><name>
<surname>Alsabri</surname>
<given-names>G</given-names>
</name>
</person-group>
<source>Virtual and traditional surgical planning in orthognathic surgery - systematic review and meta-analysis. Br J Oral Maxillofac Surg. 2022 Nov;60(9):1184-1191.</source>
<pub-id pub-id-type="pmid">36030091</pub-id>
<pub-id pub-id-type="doi">10.1016/j.bjoms.2022.07.007</pub-id>
</element-citation>
    </ref>
    <ref id="B16"><label>16</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Neo</surname>
<given-names>B</given-names>
</name><name>
<surname>Lim</surname>
<given-names>LC</given-names>
</name><name>
<surname>Mohammed-Ali</surname>
<given-names>R</given-names>
</name>
</person-group>
<source>Time benefits of 3D planning in orthognathic surgery: a systematic review. Br J Oral Maxillofac Surg. 2022 Feb;60(2):120-127.</source>
<pub-id pub-id-type="pmid">35065835</pub-id>
<pub-id pub-id-type="doi">10.1016/j.bjoms.2021.02.005</pub-id>
</element-citation>
    </ref>
    <ref id="B17"><label>17</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Nilsson</surname>
<given-names>J</given-names>
</name><name>
<surname>Hindocha</surname>
<given-names>N</given-names>
</name><name>
<surname>Thor</surname>
<given-names>A</given-names>
</name>
</person-group>
<source>Time matters - Differences between computer-assisted surgery and conventional planning in cranio-maxillofacial surgery: A systematic review and meta-analysis. J Craniomaxillofac Surg. 2020 Feb;48(2): 132-140.</source>
<pub-id pub-id-type="pmid">31955991</pub-id>
<pub-id pub-id-type="doi">10.1016/j.jcms.2019.11.024</pub-id>
</element-citation>
    </ref>
    <ref id="B18"><label>18</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Kwon</surname>
<given-names>TG</given-names>
</name><name>
<surname>Choi</surname>
<given-names>JW</given-names>
</name><name>
<surname>Kyung</surname>
<given-names>HM</given-names>
</name><name>
<surname>Park</surname>
<given-names>HS</given-names>
</name>
</person-group>
<source>Accuracy of maxillary repositioning in two-jaw surgery with conventional articulator model surgery versus virtual model surgery. Int J Oral Maxillofac Surg. 2014 Jun;43(6):732-8.</source>
<pub-id pub-id-type="pmid">24462125</pub-id>
<pub-id pub-id-type="doi">10.1016/j.ijom.2013.11.009</pub-id>
</element-citation>
    </ref>
    <ref id="B19"><label>19</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Ritto</surname>
<given-names>FG</given-names>
</name><name>
<surname>Schmitt</surname>
<given-names>ARM</given-names>
</name><name>
<surname>Pimentel</surname>
<given-names>T</given-names>
</name><name>
<surname>Canellas</surname>
<given-names>JV</given-names>
</name><name>
<surname>Medeiros</surname>
<given-names>PJ</given-names>
</name>
</person-group>
<source>Comparison of the accuracy of maxillary position between conventional model surgery and virtual surgical planning. Int J Oral Maxillofac Surg. 2018 Feb;47(2):160-166.</source>
<pub-id pub-id-type="pmid">28950997</pub-id>
<pub-id pub-id-type="doi">10.1016/j.ijom.2017.08.012</pub-id>
</element-citation>
    </ref>
    <ref id="B20"><label>20</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Ellis</surname>
<given-names>E 3rd</given-names>
</name>
</person-group>
<source>Accuracy of model surgery: evaluation of an old technique and introduction of a new one. J Oral Maxillofac Surg. 1990 Nov;48(11):1161-7.</source>
<pub-id pub-id-type="pmid">1698956</pub-id>
<pub-id pub-id-type="doi">10.1016/0278-2391(90)90532-7</pub-id>
</element-citation>
    </ref>
    <ref id="B21"><label>21</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Welch</surname>
<given-names>V</given-names>
</name><name>
<surname>Petticrew</surname>
<given-names>M</given-names>
</name><name>
<surname>Tugwell</surname>
<given-names>P</given-names>
</name><name>
<surname>Moher</surname>
<given-names>D</given-names>
</name><name>
<surname>O'Neill</surname>
<given-names>J</given-names>
</name><name>
<surname>Waters</surname>
<given-names>E</given-names>
</name><name>
<surname>White</surname>
<given-names>H</given-names>
</name>
</person-group>
<source>PRISMA-Equity Bellagio group. PRISMA-Equity 2012 extension: reporting guidelines for systematic reviews with a focus on health equity. PLoS Med. 2012;9(10):e1001333.</source>
<pub-id pub-id-type="pmid">23222917</pub-id>
<pub-id pub-id-type="pmcid">PMC 3484052</pub-id>
<pub-id pub-id-type="doi">10.1371/journal.pmed.1001333</pub-id>
</element-citation>
    </ref>
    <ref id="B22"><label>22</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Higgins</surname>
<given-names>JPT</given-names>
</name><name>
<surname>Altman</surname>
<given-names>DG</given-names>
</name><name>
<surname>Sterne</surname>
<given-names>JAC</given-names>
</name>
</person-group>
<source>Chapter 8: assessing risk of bias in included studies. In: Higgins JPT, Green S, editors. Cochrane handbook for systematic reviews of interventions version 5.1.0 (updated March 2011). The Cochrane Collaboration. 2011. URL: </source><comment><ext-link ext-link-type="uri" xlink:href="http://handbook.cochrane.org/">http://handbook.cochrane.org/</ext-link></comment>
</element-citation>
    </ref>
    <ref id="B23"><label>23</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Higgins</surname>
<given-names>JP</given-names>
</name><name>
<surname>Altman</surname>
<given-names>DG</given-names>
</name><name>
<surname>Gøtzsche</surname>
<given-names>PC</given-names>
</name><name>
<surname>Jüni</surname>
<given-names>P</given-names>
</name><name>
<surname>Moher</surname>
<given-names>D</given-names>
</name><name>
<surname>Oxman</surname>
<given-names>AD</given-names>
</name><name>
<surname>Savovic</surname>
<given-names>J</given-names>
</name><name>
<surname>Schulz</surname>
<given-names>KF</given-names>
</name><name>
<surname>Weeks</surname>
<given-names>L</given-names>
</name><name>
<surname>Sterne</surname>
<given-names>JA</given-names>
</name>
</person-group>
<source>Cochrane Bias Methods Group; Cochrane Statistical Methods Group. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ. 2011 Oct 18;343:d5928.</source>
<pub-id pub-id-type="pmid">22008217</pub-id>
<pub-id pub-id-type="pmcid">PMC 3196245</pub-id>
<pub-id pub-id-type="doi">10.1136/bmj.d5928</pub-id>
</element-citation>
    </ref>
    <ref id="B24"><label>24</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Goldet</surname>
<given-names>G</given-names>
</name><name>
<surname>Howick</surname>
<given-names>J</given-names>
</name>
</person-group>
<source>Understanding GRADE: an introduction. J Evid Based Med. 2013 Feb;6(1):50-54.</source>
<pub-id pub-id-type="pmid">23557528</pub-id>
<pub-id pub-id-type="doi">10.1111/jebm.12018</pub-id>
</element-citation>
    </ref>
    <ref id="B25"><label>25</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>De Riu</surname>
<given-names>G</given-names>
</name><name>
<surname>Meloni</surname>
<given-names>SM</given-names>
</name><name>
<surname>Baj</surname>
<given-names>A</given-names>
</name><name>
<surname>Corda</surname>
<given-names>A</given-names>
</name><name>
<surname>Soma</surname>
<given-names>D</given-names>
</name><name>
<surname>Tullio</surname>
<given-names>A</given-names>
</name>
</person-group>
<source>Computer-assisted orthognathic surgery for correction of facial asymmetry: results of a randomised controlled clinical trial. Br J Oral Maxillofac Surg. 2014 Mar;52(3):251-7.</source>
<pub-id pub-id-type="pmid">24418178</pub-id>
<pub-id pub-id-type="doi">10.1016/j.bjoms.2013.12.010</pub-id>
</element-citation>
    </ref>
    <ref id="B26"><label>26</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Van Hemelen</surname>
<given-names>G</given-names>
</name><name>
<surname>Van Genechten</surname>
<given-names>M</given-names>
</name><name>
<surname>Renier</surname>
<given-names>L</given-names>
</name><name>
<surname>Desmedt</surname>
<given-names>M</given-names>
</name><name>
<surname>Verbruggen</surname>
<given-names>E</given-names>
</name><name>
<surname>Nadjmi</surname>
<given-names>N</given-names>
</name>
</person-group>
<source>Three-dimensional virtual planning in orthognathic surgery enhances the accuracy of soft tissue prediction. J Craniomaxillofac Surg. 2015 Jul;43(6):918-25.</source>
<pub-id pub-id-type="pmid">26027866</pub-id>
<pub-id pub-id-type="doi">10.1016/j.jcms.2015.04.006</pub-id>
</element-citation>
    </ref>
    <ref id="B27"><label>27</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Bengtsson</surname>
<given-names>M</given-names>
</name><name>
<surname>Wall</surname>
<given-names>G</given-names>
</name><name>
<surname>Larsson</surname>
<given-names>P</given-names>
</name><name>
<surname>Becktor</surname>
<given-names>JP</given-names>
</name><name>
<surname>Rasmusson</surname>
<given-names>L</given-names>
</name>
</person-group>
<source>Treatment outcomes and patient-reported quality of life after orthognathic surgery with computer-assisted 2- or 3-dimensional planning: A randomized double-blind active-controlled clinical trial. Am J Orthod Dentofacial Orthop. 2018 Jun;153(6):786-796.</source>
<pub-id pub-id-type="pmid">29853236</pub-id>
<pub-id pub-id-type="doi">10.1016/j.ajodo.2017.12.008</pub-id>
</element-citation>
    </ref>
    <ref id="B28"><label>28</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Schneider</surname>
<given-names>D</given-names>
</name><name>
<surname>Kämmerer</surname>
<given-names>PW</given-names>
</name><name>
<surname>Hennig</surname>
<given-names>M</given-names>
</name><name>
<surname>Schön</surname>
<given-names>G</given-names>
</name><name>
<surname>Thiem</surname>
<given-names>DGE</given-names>
</name><name>
<surname>Bschorer</surname>
<given-names>R</given-names>
</name>
</person-group>
<source>Customized virtual surgical planning in bimaxillary orthognathic surgery: a prospective randomized trial. Clin Oral Investig. 2019 Jul;23(7):3115-3122.</source>
<pub-id pub-id-type="pmid">30443778</pub-id>
<pub-id pub-id-type="doi">10.1007/s00784-018-2732-3</pub-id>
</element-citation>
    </ref>
    <ref id="B29"><label>29</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Hanafy</surname>
<given-names>M</given-names>
</name><name>
<surname>Akoush</surname>
<given-names>Y</given-names>
</name><name>
<surname>Abou-ElFetouh</surname>
<given-names>A</given-names>
</name><name>
<surname>Mounir</surname>
<given-names>RM</given-names>
</name>
</person-group>
<source>Precision of orthognathic digital plan transfer using patient-specific cutting guides and osteosynthesis versus mixed analogue-digitally planned surgery: a randomized controlled clinical trial. Int J Oral Maxillofac Surg. 2020 Jan;49(1):62-68.</source>
<pub-id pub-id-type="pmid">31262680</pub-id>
<pub-id pub-id-type="doi">10.1016/j.ijom.2019.06.023</pub-id>
</element-citation>
    </ref>
    <ref id="B30"><label>30</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Xu</surname>
<given-names>R</given-names>
</name><name>
<surname>Ye</surname>
<given-names>N</given-names>
</name><name>
<surname>Zhu</surname>
<given-names>S</given-names>
</name><name>
<surname>Shi</surname>
<given-names>B</given-names>
</name><name>
<surname>Li</surname>
<given-names>J</given-names>
</name><name>
<surname>Lai</surname>
<given-names>W</given-names>
</name>
</person-group>
<source>Comparison of the postoperative and follow-up accuracy of articulator model surgery and virtual surgical planning in skeletal class III patients. Br J Oral Maxillofac Surg. 2020 Oct;58(8):933-939.</source>
<pub-id pub-id-type="pmid">32446591</pub-id>
<pub-id pub-id-type="doi">10.1016/j.bjoms.2020.04.032</pub-id>
</element-citation>
    </ref>
    <ref id="B31"><label>31</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Chen</surname>
<given-names>H</given-names>
</name><name>
<surname>Bi</surname>
<given-names>R</given-names>
</name><name>
<surname>Hu</surname>
<given-names>Z</given-names>
</name><name>
<surname>Chen</surname>
<given-names>J</given-names>
</name><name>
<surname>Jiang</surname>
<given-names>N</given-names>
</name><name>
<surname>Wu</surname>
<given-names>G</given-names>
</name><name>
<surname>Li</surname>
<given-names>Y</given-names>
</name><name>
<surname>Luo</surname>
<given-names>E</given-names>
</name><name>
<surname>Zhu</surname>
<given-names>S</given-names>
</name>
</person-group>
<source>Comparison of three different types of splints and templates for maxilla repositioning in bimaxillary orthognathic surgery: a randomized controlled trial. Int J Oral Maxillofac Surg. 2021 May;50(5):635-642.</source>
<pub-id pub-id-type="pmid">33131986</pub-id>
<pub-id pub-id-type="doi">10.1016/j.ijom.2020.09.023</pub-id>
</element-citation>
    </ref>
    <ref id="B32"><label>32</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Song</surname>
<given-names>KG</given-names>
</name><name>
<surname>Baek</surname>
<given-names>SH</given-names>
</name>
</person-group>
<source>Comparison of the accuracy of the three-dimensional virtual method and the conventional manual method for model surgery and intermediate wafer fabrication. Oral Surg Oral Med Oral Pathol Oral Radiol Endod. 2009 Jan;107(1):13-21.</source>
<pub-id pub-id-type="pmid">18755612</pub-id>
<pub-id pub-id-type="doi">10.1016/j.tripleo.2008.06.002</pub-id>
</element-citation>
    </ref>
    <ref id="B33"><label>33</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Demirsoy</surname>
<given-names>KK</given-names>
</name><name>
<surname>Kurt</surname>
<given-names>G</given-names>
</name>
</person-group>
<source>Accuracy of 3 Soft Tissue Prediction Methods After Double-Jaw Orthognathic Surgery in Class III Patients. Ann Plast Surg. 2022 Mar 1;88(3):323-329.</source>
<pub-id pub-id-type="pmid">34670968</pub-id>
<pub-id pub-id-type="doi">10.1097/SAP.0000000000002988</pub-id>
</element-citation>
    </ref>
    <ref id="B34"><label>34</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Chen</surname>
<given-names>C</given-names>
</name><name>
<surname>Sun</surname>
<given-names>N</given-names>
</name><name>
<surname>Jiang</surname>
<given-names>C</given-names>
</name><name>
<surname>Sun</surname>
<given-names>J</given-names>
</name>
</person-group>
<source>Randomized Controlled Clinical Trial to Assess the Utility of Computer-Aided Intraoperative Navigation in Bimaxillary Orthognathic Surgery. J Craniofac Surg. 2021 Sep 1;32(6):2205-2209.</source>
<pub-id pub-id-type="pmid">33538444</pub-id>
<pub-id pub-id-type="doi">10.1097/SCS.0000000000007512</pub-id>
</element-citation>
    </ref>
    <ref id="B35"><label>35</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Kraeima</surname>
<given-names>J</given-names>
</name><name>
<surname>Schepers</surname>
<given-names>RH</given-names>
</name><name>
<surname>Spijkervet</surname>
<given-names>FKL</given-names>
</name><name>
<surname>Maal</surname>
<given-names>TJJ</given-names>
</name><name>
<surname>Baan</surname>
<given-names>F</given-names>
</name><name>
<surname>Witjes</surname>
<given-names>MJH</given-names>
</name><name>
<surname>Jansma</surname>
<given-names>J</given-names>
</name>
</person-group>
<source>Splintless surgery using patient-specific osteosynthesis in Le Fort I osteotomies: a randomized controlled multi-centre trial. Int J Oral Maxillofac Surg. 2020 Apr;49(4):454-460.</source>
<pub-id pub-id-type="pmid">31506186</pub-id>
<pub-id pub-id-type="doi">10.1016/j.ijom.2019.08.005</pub-id>
</element-citation>
    </ref>
    <ref id="B36"><label>36</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Bengtsson</surname>
<given-names>M</given-names>
</name><name>
<surname>Wall</surname>
<given-names>G</given-names>
</name><name>
<surname>Greiff</surname>
<given-names>L</given-names>
</name><name>
<surname>Rasmusson</surname>
<given-names>L</given-names>
</name>
</person-group>
<source>Treatment outcome in orthognathic surgery-A prospective randomized blinded case-controlled comparison of planning accuracy in computer-assisted two- and three-dimensional planning techniques (part II). J Craniomaxillofac Surg. 2017 Sep;45(9):1419-1424.</source>
<pub-id pub-id-type="pmid">28800842</pub-id>
<pub-id pub-id-type="doi">10.1016/j.jcms.2017.07.001</pub-id>
</element-citation>
    </ref>
    <ref id="B37"><label>37</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Bengtsson</surname>
<given-names>M</given-names>
</name><name>
<surname>Wall</surname>
<given-names>G</given-names>
</name><name>
<surname>Miranda-Burgos</surname>
<given-names>P</given-names>
</name><name>
<surname>Rasmusson</surname>
<given-names>L</given-names>
</name>
</person-group>
<source>Treatment outcome in orthognathic surgery - A prospective comparison of accuracy in computer assisted two and three-dimensional prediction techniques. J Craniomaxillofac Surg. 2018 Nov;46(11):1867-1874.</source>
<pub-id pub-id-type="pmid">28318923</pub-id>
<pub-id pub-id-type="doi">10.1016/j.jcms.2017.01.035</pub-id>
</element-citation>
    </ref>
    <ref id="B38"><label>38</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Bengtsson</surname>
<given-names>M</given-names>
</name><name>
<surname>Wall</surname>
<given-names>G</given-names>
</name><name>
<surname>Becktor</surname>
<given-names>JP</given-names>
</name><name>
<surname>Rasmusson</surname>
<given-names>L</given-names>
</name>
</person-group>
<source>A comparison of cost-effectiveness of computer-assisted 2-and 3-dimensional planning techniques in orthognathic surgery. Br J Oral Maxillofac Surg. 2019 May;57(4):352-358.</source>
<pub-id pub-id-type="pmid">30962030</pub-id>
<pub-id pub-id-type="doi">10.1016/j.bjoms.2019.03.012</pub-id>
</element-citation>
    </ref>
    <ref id="B39"><label>39</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Bengtsson</surname>
<given-names>M</given-names>
</name><name>
<surname>Al-Ateyah</surname>
<given-names>A</given-names>
</name><name>
<surname>Wall</surname>
<given-names>G</given-names>
</name><name>
<surname>Becktor</surname>
<given-names>JP</given-names>
</name><name>
<surname>Rasmusson</surname>
<given-names>L</given-names>
</name>
</person-group>
<source>Outcome of photographic evaluation of facial appearance in orthognathic surgery: how does it correlate with planning of treatment and patient-reported outcome? Br J Oral Maxillofac Surg. 2019 May;57(4):345-351.</source>
<pub-id pub-id-type="pmid">31000205</pub-id>
<pub-id pub-id-type="doi">10.1016/j.bjoms.2018.12.019</pub-id>
</element-citation>
    </ref>
    <ref id="B40"><label>40</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Hanafy</surname>
<given-names>M</given-names>
</name><name>
<surname>Abou-Elfetouh</surname>
<given-names>A</given-names>
</name><name>
<surname>Mounir</surname>
<given-names>RM</given-names>
</name>
</person-group>
<source>Quality of life after different approaches of orthognathic surgery: a randomized controlled study. Minerva Stomatol. 2019 Jun;68(3):112-117.</source>
<pub-id pub-id-type="pmid">31014060</pub-id>
<pub-id pub-id-type="doi">10.23736/S0026-4970.19.04227-4</pub-id>
</element-citation>
    </ref>
    <ref id="B41"><label>41</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Hanafy</surname>
<given-names>M</given-names>
</name><name>
<surname>Abou-Elfetouh</surname>
<given-names>A</given-names>
</name><name>
<surname>Mounir</surname>
<given-names>RM</given-names>
</name>
</person-group>
<source>Accuracy assessment of CAD/CAM generated surgical guides and patient-specific osteosynthesis compared to classic model surgery in patients with dentofacial deformities. A randomized controlled clinical trial. Int J Oral Maxillofac Surg. 2019 May;48, ICOMS 2019 Abstract Only Supplement:121.</source>
<pub-id pub-id-type="doi">10.1016/j.ijom.2019.03.372</pub-id>
</element-citation>
    </ref>
    <ref id="B42"><label>42</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Zinser</surname>
<given-names>MJ</given-names>
</name><name>
<surname>Sailer</surname>
<given-names>HF</given-names>
</name><name>
<surname>Ritter</surname>
<given-names>L</given-names>
</name><name>
<surname>Braumann</surname>
<given-names>B</given-names>
</name><name>
<surname>Maegele</surname>
<given-names>M</given-names>
</name><name>
<surname>Zöller</surname>
<given-names>JE</given-names>
</name>
</person-group>
<source>A paradigm shift in orthognathic surgery? A comparison of navigation, computer-aided designed/computer-aided manufactured splints, and "classic" intermaxillary splints to surgical transfer of virtual orthognathic planning. J Oral Maxillofac Surg. 2013 Dec;71(12):2151.e1-21.</source>
<pub-id pub-id-type="pmid">24237776</pub-id>
<pub-id pub-id-type="doi">10.1016/j.joms.2013.07.007</pub-id>
</element-citation>
    </ref>
    <ref id="B43"><label>43</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Sánchez-Jáuregui</surname>
<given-names>E</given-names>
</name><name>
<surname>Baranda-Manterola</surname>
<given-names>E</given-names>
</name><name>
<surname>Ranz-Colio</surname>
<given-names>Á</given-names>
</name><name>
<surname>Bueno de Vicente</surname>
<given-names>Á</given-names>
</name><name>
<surname>Acero-Sanz</surname>
<given-names>J</given-names>
</name>
</person-group>
<source>Custom made cutting guides and osteosynthesis plates versus CAD/CAM occlusal splints in positioning and fixation of the maxilla in orthognathic surgery: A prospective randomized study. J Craniomaxillofac Surg. 2022 Aug;50(8):609-614.</source>
<pub-id pub-id-type="pmid">35760659</pub-id>
<pub-id pub-id-type="doi">10.1016/j.jcms.2022.05.010</pub-id>
</element-citation>
    </ref>
    <ref id="B44"><label>44</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Alqussair</surname>
<given-names>A</given-names>
</name><name>
<surname>Baek</surname>
<given-names>SH</given-names>
</name><name>
<surname>Kim</surname>
<given-names>TS</given-names>
</name><name>
<surname>Ha</surname>
<given-names>SH</given-names>
</name><name>
<surname>Choi</surname>
<given-names>JY</given-names>
</name>
</person-group>
<source>Surgical Accuracy of Positioning the Maxilla in Patients With Skeletal Class II Malocclusion Using Computer-Aided Design and Computer-Aided Manufacturing-Assisted Orthognathic Surgery. J Craniofac Surg. 2022 Jul-Aug 01;33(5):1479-1483.</source>
<pub-id pub-id-type="pmid">34907951</pub-id>
<pub-id pub-id-type="doi">10.1097/SCS.0000000000008407</pub-id>
</element-citation>
    </ref>
    <ref id="B45"><label>45</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Wong</surname>
<given-names>A</given-names>
</name><name>
<surname>Goonewardene</surname>
<given-names>MS</given-names>
</name><name>
<surname>Allan</surname>
<given-names>BP</given-names>
</name><name>
<surname>Mian</surname>
<given-names>AS</given-names>
</name><name>
<surname>Rea</surname>
<given-names>A</given-names>
</name>
</person-group>
<source>Accuracy of maxillary repositioning surgery using CAD/CAM customized surgical guides and fixation plates. Int J Oral Maxillofac Surg. 2021 Apr;50(4):494-500.</source>
<pub-id pub-id-type="pmid">32919821</pub-id>
<pub-id pub-id-type="doi">10.1016/j.ijom.2020.08.009</pub-id>
</element-citation>
    </ref>
    <ref id="B46"><label>46</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Kesmez</surname>
<given-names>Ö</given-names>
</name><name>
<surname>Valls-Ontañón</surname>
<given-names>A</given-names>
</name><name>
<surname>Starch-Jensen</surname>
<given-names>T</given-names>
</name><name>
<surname>Haas-Junior</surname>
<given-names>OL</given-names>
</name><name>
<surname>Hernández-Alfaro</surname>
<given-names>F</given-names>
</name>
</person-group>
<source>Virtual surgical planning in orthognathic surgery with the use of patient-specific plates compared with conventional plates. A systematic review focusing on complications, financial expenses, professional and patient-reported outcome measures. Med Oral Patol Oral Cir Bucal. 2022 Nov 1;27(6):e507-e517.</source>
<pub-id pub-id-type="pmid">36173724</pub-id>
<pub-id pub-id-type="pmcid">PMC 9648647</pub-id>
<pub-id pub-id-type="doi">10.4317/medoral.25424</pub-id>
</element-citation>
    </ref>
    <ref id="B47"><label>47</label>
      <element-citation>
        <person-group person-group-type="author">
          <name>
<surname>Suojanen</surname>
<given-names>J</given-names>
</name><name>
<surname>Järvinen</surname>
<given-names>S</given-names>
</name><name>
<surname>Kotaniemi</surname>
<given-names>KV</given-names>
</name><name>
<surname>Reunanen</surname>
<given-names>J</given-names>
</name><name>
<surname>Palotie</surname>
<given-names>T</given-names>
</name><name>
<surname>Stoor</surname>
<given-names>P</given-names>
</name><name>
<surname>Leikola</surname>
<given-names>J</given-names>
</name>
</person-group>
<source>Comparison between patient specific implants and conventional mini-plates in Le Fort I osteotomy with regard to infections: No differences in up to 3-year follow-up. J Craniomaxillofac Surg. 2018 Oct;46(10):1814-1817.</source>
<pub-id pub-id-type="pmid">30097411</pub-id>
<pub-id pub-id-type="doi">10.1016/j.jcms.2018.07.011</pub-id>
</element-citation>
    </ref>
    </ref-list>
</back>
</article>