<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">ijbf</journal-id>
      <journal-title-group>
        <journal-title>International Journal of Banking and Finance</journal-title>
        <abbrev-journal-title abbrev-type="publisher">IJBF</abbrev-journal-title>
      </journal-title-group>
      <issn pub-type="ppub">2811-3799</issn>
      <issn pub-type="epub">2590-423X</issn>
      <publisher><publisher-name>UUM PRESS</publisher-name></publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.32890/ijbf2009.6.1.8</article-id>
      <article-id pub-id-type="publisher-id">6859</article-id>
      <article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group></article-categories>
      <title-group>
        <article-title>An Empirical Investigation of New Bond Issue Yield Spreads, Default Risk and Split Ratings</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author" corresp="yes">
          <name>
            <surname>S. Michael</surname>
            <given-names>Timothy</given-names>
          </name>
          <xref ref-type="aff" rid="aff1"/>
          <email>michael@uhcl.edu</email>
        </contrib>
      </contrib-group>
      <aff id="aff1"><institution>University of Houston Clarke-Lake</institution>, <country country="US">United States</country></aff>
      <pub-date publication-format="electronic" date-type="pub" iso-8601-date="2009-03-17">
        <day>17</day><month>03</month><year>2009</year>
      </pub-date>
      <volume>6</volume>
      <issue>1</issue>
      <fpage>141</fpage>
      <lpage>160</lpage>
      <permissions>
        <copyright-statement>Copyright &#169; 2009 UUM PRESS</copyright-statement>
        <copyright-year>2009</copyright-year>
        <license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0">
          <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International License.</license-p>
        </license>
      </permissions>
      <kwd-group kwd-group-type="author">
        <kwd>Yield spreads</kwd>
        <kwd>Split ratings</kwd>
        <kwd>Bond index</kwd>
        <kwd>Credit rating effect,</kwd>
        <kwd>Terms of debt issues</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <p>I. Introduction The inﬂuences of credit ratings and disagreement between rating agencies and the interactions between these characteristics are issues that are addressed in this paper. We include in this paper new ﬁndings on the contributions of sinking fund provisions, call status, overseas issues and contractual security arrangements. The yield spreads of debt issues contain important information for investment analysts to judge the level of risk of an issue. Therefore, an analysis of the yield spreads to identify the factors in a debt issue is expected to add to our understanding of risk of an issue thus aiding analysts in their investment evaluation.</p>
    <p>The model tested in this paper was most inﬂuenced by a prior work on split bond ratings and security yields by Billingsley, Lamy, Marr, and Thompson (1985) (BLMT). In their model, BLMT measure the yield off-Treasury (YOT) for new securities, deﬁned as issuing yield less Moody’s index of long-term government bonds on the issue date. To explain this spread measure, they used the average daily interest rate (level) on Moody’s long-term Treasury bond index, an absolute deviation measure of volatility in interest rates for the ten days prior to the issue date, a quality spread of the average yield on long-term corporate bonds over the Treasury index rate on the issue date, the natural log of the issue size, the term to maturity of the issue, and the minimum number of years until ﬁrst call. They also include dummy variables for four Moody’s rating classes, the existence of a sinking fund provision, and four separate split rating categories for single interclass splits.1 The rest of the paper is organized as follows. Section 2 is a review of the literature relating to the yield spreads at the time of issue relating to split ratings by two rating companies. In section 3 we present the research design of this study, and the results are discussed in section 4. The paper ends with comments in section 5. 2. Brief Review of Related Literature For a sample of 258 new industrial bonds issued between 1977 and 1983, BLMT ﬁnd signiﬁcant relationships between YOT and an overall quality spread, the level of interest rates, term to maturity, call term, and all four ratings classes (the omitted class, as represented by the intercept term, was not signiﬁcant). In addition, the coefﬁcients for the split categories Aaa/Aa, Aa/A and A/Ba are also signiﬁcantly different from zero, and inversely related to the YOT. Using a standard F-test for a subset of coefﬁcients, BLMT show that the coefﬁcients on the class dummies are signiﬁcantly different in all but the Aaa versus Aa case. Their results indicate that split rating coefﬁcients are signiﬁcantly related to the higher rating class (with the exception of the Aaa/Aa split), suggesting that the market may weigh bad information more heavily when assigning initial yields to an issue which has caused a difference in rating agency opinion. In other words, there is a signiﬁcant difference in yields when (for their sample) the Moody’s rating of the issue is higher than that given by Standard and Poor’s. The potential impact of the BLMT (1985) results suffers from a lack of degrees of freedom. As pointed out by Perry, Liu and Evans (1988), of the 258 issues in the BLMT study, only 33 have a split rating, making the ﬁne distinctions found by BLMT little suspect, or at least in need of conﬁrmation by a larger sample. Perry, Liu and Evans (1988) conﬁrm the relationship between splits, yields, and the higher ratings class for a larger sample, again using each</p>
    <p>An example of an interclass split would be an issue rated Aaa by Moody’s and AA by Standard and Poors. No provision was made to measure the splits across more than just broad classes. Revised categories, which distinguish between three different intraclass ratings, were not used in the BLMT study.</p>
    <p>issue’s Moody rating as a base. Liu and Moore (1987) reafﬁrm the these prior relationships, but show that the phenomenon is not signiﬁcantly different for Moody’s versus Standard and Poor’s, suggesting that a large premium is demanded from any issue which is rated lower than the rating on a benchmark portfolio of equally-rated bonds. There is also a stream of literature which explores the relationship between security ratings, default risk and split ratings, and these studies question the ability of credit ratings to capture the market’s full assessment of default risk at different points in a security’s life. This line of research is characterized by the studies of Ederington (1986), Ederington, Yawitz and Roberts (1987), and Reiter and Ziebart (1991).2 Evidence from this body of works suggests that ratings may become “stale” for some ﬁrms since rating agencies may not revise a ﬁrm’s credit ratings at regular or frequent intervals. As a response to concerns about this issue in the current study, it should be pointed out that the inaccuracy of ratings in capturing the default risk of a particular security should be small for new issues relative to seasoned securities. Most prior studies designed to evaluate default risk proxies have used samples of outstanding bonds. The default risk literature provides evidence that credit rating categories are signiﬁcantly related to new issue yields. For example, Ederington, Yawitz, and Roberts (1987) show that ratings are signiﬁcant and capture most of the variation in yields, even when combined with ﬁrm-speciﬁc accounting measures. The credit rating assigned a new issue is likely to be the most complete timely measure of default risk available to the majority of bond investors. Another question from default risk research is whether yields are determined by credit ratings or credit ratings are determined by issue yields. Reiter and Ziebart (1991), Kao and Wu (1994) and Liu and Thakor (1984) all recognize the simultaneity of bond rating and price determination. This problem is not addressed in the current paper, other than to suggest that the direction of causality for new issues is probably more from ratings to yields. This relationship should be clearest for a new security given the nature and timing of the issuing process, which also impacts new issue liquidity. The direct effect of illiquidity on seasoned corporate bond prices is well documented. Zivney, Bertin and Torabzadeh (1993) review the impact of infrequent trading on the availability and quality of high-yield bond price data. For the present study, conﬁning the sample to yields on new issues is partly an attempt to minimize liquidity differences between a particular new issue, Treasury securities, and the bonds included in Moody’s Aaa Corporate Bond index. If systematic liquidity effects exist, they should be smallest at issue time. This assertion acknowledges the discretionary nature of most debt issues - investment bankers advise ﬁrms (or savvy ﬁrms know) when to issue based</p>
    <p>Kaplan and Urwitz (1979) show that studies attempting to explain bond ratings using standard OLS models and a categorical dependent variable for rating class are ﬂawed. As a result of their original study, ordered probit models of ratings have been developed over the past decade. These newer models are used in most of the recent research on default risk.</p>
    <p>on the banker’s ability to sell at some target price. The ﬁnal data used here are made up of only those securities for which a substantial amount of information is present at the time of issue; these are likely to be the most actively traded securities once they are issued. The models tested in this paper are also guided by the sinking fund model of Kidwell, Marr, and Ogden (1989), which uses a standard YOT equation with interaction terms to measure the potential slope differences for sinking fund issues as they relate to the overall level of interest rates and an ordered probit model measure of default risk. The sample included 192 new utility issues during 1977 and 1982 period. Both of these interactions are highly signiﬁcant in that study, but a simple dummy variable for sinking fund presence was only signiﬁcant at the 0.10 acceptance level. A similar model explaining yield level rather than a quality spread is estimated by Kidwell, Marr and Thompson (1984). Both studies included some measure of term to maturity, the overall level of interest rates, and some recognition of the call provision associated with the issue. These variables added explanatory power in each case. Other related models are the yield models of Sorensen (1981 and 1979). Hsueh and Chandy (1989) developed a similar model for the net issuing cost of insured and uninsured municipal bonds.</p>
    <sec id="sec7">
      <label>3</label>
      <title>Research Design</title>
      <p>A basic model of the quoted interest rate on a debt security is given by Brigham and Gapenski (1994, pg. 103): Yi = k* + IPi + LPi + MRPi where, Y is the quoted rate on security i, k* is the real risk-free rate of interest, IP is an inﬂation premium, DRP is a default risk premium, LP is a premium for liquidity risk, and MRP is a premium for maturity risk. At any point in a debt security’s life, it should be possible to decompose its yield into subsets resembling those in the quoted rate expression. Similarly, the simplest way to measure any set of the right-hand-side premia is to subtract from both sides the yield on a security which is similar to the measured security in all but the targeted set of characteristics. A Treasury yield, for example, contains the real rate, inﬂation expectations, and if it is of the same term as the measured bond, the same maturity risk premium, leaving default and liquidity risk to explain the yield differential.3 Liquidity effects can be reduced by using new issue information, so this example would end up being primarily a model of default risk.</p>
      <p>Kidwell, Marr and Ogden (1989) indicate that new issue yields should not reﬂect any differences in price due to different coupon rates on the compared securities because most issues are priced close to par at issue. To make sure that this kind of inﬂuence was removed from the sample, original-issue-discount bonds were dropped, as described in Section 4.</p>
      <p>For the set of corporate debt securities which have been rated by Moody’s and Standard &amp; Poor’s, the default risk component of a security’s yield can be broken into two parts. As a base, the spread between an index of Aaa corporate bonds and the constant maturity Treasury rate for a particular term represents the minimum default spread charged in the market on a given issuing day. The default premium on any new security should be greater than or equal to this Aaa quality spread on the day the reissuing price is set, which may be up to a week prior to issue.4 In other words, the difference between the measured new issue yield and a Treasury rate will contain or at least be a function of the default premium on an index of Aaa bonds on the issue date. The difference between the premium paid by a Aaa bond (or index) and the new issue will contain premia to pay for all other sources of default risk. In reality, and as measured here, this difference will contain components of liquidity risk and perhaps maturity risk as well. The base model evaluated in this paper is of the form: Yi,d,T = Td,T + [(Aaa index)d – Td,T] + DRPi + other premia</p>
      <p>YOTi = (Yi,d,T – Td,T) = [(Aaa index)d – Td,T] + DRPi + other premia</p>
      <p>Where, Yi,d,T is the observed yield on new issue i on issue data d with a term to maturity of T years. Td,T is the day d observed yield on a Treasury security with a term to maturity of T years.5 The Aaa index measure is the last weekly yield on Moody’s Aaa Corporate Bond index for the week up to and including the issue date, and DRPi is a unique default risk premium for the new issue. The general category “other premia” may contain a great deal of pricing information. The analysis in this paper limits the investigation of this category to residual term effects, the effect of gross issue size, the yield premium demanded for issuing abroad (“Euro” securities), the level of volatility in an overall quality spread for corporate bond yields for some period prior to issue, and the effect of having a call or refunding provision. Differential default risk is measured as outlined above, using a quality spread for corporate yields, deﬁned as Moody’s Aaa Corporate Bond index less the constant maturity Treasury yield corresponding to the exact term to maturity of the measured issue.6 Default</p>
      <p>To the extent that the Aaa bond index is a noisy measure of the current yield paid by high quality credits, this model is ﬂawed. The data series used here -- weekly values of Moody’s Aaa Corporate Bond index -- is the most accurate available from public electronic sources. Better precision could be obtained by matching each new issue with an actual Aaa corporate bond of the same term on the issue date, but this would introduce other factors into the model. I chose to subtract Treasuries from issue yield in order to reduce measurement error and collinearity inﬂuences on the right-hand-side of the model; measurement error in the YOT affects the size of the error term. Moody’s Aaa Corporate Bond index for one and two weeks prior to the issue date were also tested in relation to each of the models developed. The results reported were the most signiﬁcant.</p>
      <p>risk is also measured by categorical variables for six separate Moody’s rating classes: Aaa, Aa, A, Baa, Ba, and B. In addition, dummy variables for secured issues, the existence of sinking fund provisions, and disagreement between credit rating ﬁrms (split ratings) are included. Following an initial speciﬁcation and estimation, separate categories indicating the magnitude (1 through 3 revised rating subclasses) and direction (positive or negative) of rating splits are introduced and tested. Finally, a respeciﬁed model adds interactions between the rating classes and the split magnitude and direction terms. The issue’s YOT is a spread over some base rate, which may or may not be known or well-proxied by an observable rate. The right side of this equation may contain many items related to the issue that are not found in the base rate or its proxy, yet there is no sound theoretical reason that an interest rate level component should contribute to the yield spread on the left. Models which use full interest rates to explain yield spread are assuming a great deal about the timeseries behavior of default risk.7 As another consideration, an interest rate level may be highly collinear with other explanatory variables. At least two existing studies (Perry, Liu and Evans (1988) and Liu and Moore (1987)) avoid this question and measure the impact of ratings splits on yields spreads in directly. The results of both of these studies are robust to this criticism. This study was originally designed to take advantage of data recently made available by the Capital Markets Division of the Federal Reserve Board of Governors.8 The full data base is composed of 10,286 new corporate debt securities of varying characteristics issued between 1982 and 1993, with information originally taken from The Wall Street Journal, S&amp;P Credit Week, Moody’s Bond Survey, Investment Dealer’s Digest, International Financing Review, and Bloomberg Business News (Guedes and Opler (1995)).9 Though incomplete for some items, the data set includes for most issues the gross amount, initial yield, coupon rate, issue date, maturity date, Standard &amp; Poor’s rating, Moody’s rating, date (year) of ﬁrst call, ﬁrst refunding date, and the ﬁrst sinking fund payment date (year). In addition, there are several classiﬁcation items provided which describe some of the relevant characteristics of each issue, such as whether it is convertible, an original-issue-discount (OID) security, or was sold in relation to a merger or swap. Using all of these indicators combined, it was possible to reduce the initial set to a group of 4,647 debt securities with issue dates between January 3, 1983</p>
      <p>Given the obvious popularity of using rates levels to explain rate spreads, there may be extremely valid theoretical reasons for including the absolute magnitude of interest rates in models. It stills seems counterintuitive to the author. The complete data set in raw form is available in both comma-separated-value (CSV) and Excel formats from Dr. Tim Opler’s World-Wide Web page at http://www.cob.ohiostate.edu/dept/ﬁn/osudata.htm. Guedes and Opler (1995) report 10,287 records in the original ﬁle. For this paper, the data ﬁle was read into DBFAST 2.0 as text and number ﬁelds and converted to a Dbase III format data matrix. The original number of observations in the data set when read was 10,286.</p>
      <p>and June 30, 1993. Approximately 1,300 issues were dropped for not having a listed maturity date. Issues were kept if they were rated at issue by both Moody’s and Standard and Poor’s (approximately 6,300 issues). Securities without an entry for either rating or with a UN or NR listing were deleted. Issues without yield or gross issue size numbers were also removed. From the remaining securities, the following major categories were deleted: convertibles, warrant bonds, unit issues, foreign bonds, guaranteed or government-backed issues, private placements, OID issues, participation certiﬁcates, RESETs, “Poison put” issues, Merrill-Lynch LYONS, variable or adjustable rate securities, merger related securities, and securities with speciﬁc event risk covenants. The remaining observations should include only short, medium and longterm straight debt, notes, mortgage bonds (and other secured issues) meeting the above criteria. The original data does not provide any way to divide the individual issuers into their appropriate industries.10 For this reason, the data set contains issues by utility, industrial and ﬁnancial ﬁrms. An anticipated extension of this paper will be to correct the data for obvious industry effects by removing all but industrial ﬁrms from the sample. This data also include multiple issues by the same ﬁrm if they meet the qualiﬁcations listed. Each valid observation was subsequently matched to a daily Treasury yield by term and issue date. Information for comparable Treasury securities was obtained from Federal Reserve Statistical Release H.15.11 For each issue date, this source provides a daily yield on an index of government bonds with maturities between ten and thirty years, daily constant maturity (CM) Treasury yields for 1, 2, 3, 5, 7, 10 and 30 year maturities, and most daily 20-year CM rates between 1982 and 1987. After matching, 3,293 securities had issue dates and terms corresponding to the available Treasury yield data. These matching rates were subtracted from issue yield to obtain YSPRCMA, the actual yield spread on the date of issue for each security. These were then matched to weekly observations (daily averages) of Moody’s Aaa Corporate Bond index in order to calculate the explaining spread variable CMQSYLD, which is the Aaa index yield minus the actual comparable constant maturity rate for each issue on the issue date. Table 1 gives the distribution by year and term for the ﬁnal sample of new securities.12</p>
      <p>Guedes and Opler (1995) report that out of 10,287 observations, they were able to match 7,369 to Standard and Poors COMPUSTAT (presumably by CUSIP number, which is included in the data set). This would allow for industry identiﬁcation. In addition, they report that their models often used fewer than 7,369 observations due to missing data in the COMPUSTAT ﬁles. Weekly and daily numbers for key interest rates are available in a variety of ﬁles and formats from the Federal Reserve at either its Chicago or St. Louis district banks. The electronic resources of the entire Federal Reserve System can be accessed in the FRED data base, located at http://www.stls.frb.org. Note that the totals in each table are adjusted for the removal of outliers as discussed in Section V., below.</p>
      <table-wrap id="tbl1">
        <label>Table 1</label>
        <caption><title>Annual security issues by term to maturity</title></caption>
      </table-wrap>
      <p>For the sample of 3,285 new corporate debt securities issued between January 3, 1983 and June 30, 1993, with known maturity dates and yields which could be matched by term to maturity with a constant maturity Treasury rate on the date of issue. This sample does not include any convertible, original-issue-discount, ﬂoating rate or foreign issues. Note: 20-year constant maturity Treasury rates are only available prior to 1987 and after June 1993. Term was measured as the number of years from the issue date until the listed maturity date (when available) or as the number of years between the maturity year and the year of issue. Term to Maturity (in years) Year</p>
      <p>Totals:</p>
      <p>Total</p>
      <p>Avg.</p>
      <sec id="sec7-1">
        <title>Grand Total: 3,287 issues</title>
        <p>Table 2 presents descriptive statistics for the important measured and calculated variables YIELD, CMYLD, YOT, CMQSYLD and GROSS for each year of sample data. These statistics indicate the means, variability and the range of values by year. The means of the four variables indicate that the measures are in line with previously reported ﬁgures, although these measures are from a very large sample used in this study. The data set contains issue with maturities of 1 to 30 years (see the columns) across 11 years as rated by the rating agencies. There is a total of 3,287 observations in this study. Table 3 shows the breakdown of the four non-rating categories (EURO, SECDUM, CRFDUM and SFDUM) and the SPLIT dummy variable for each year. The categories in Table 3 are not mutually exclusive.</p>
        <table-wrap id="tbl2">
          <label>Table 2</label>
          <caption><title>Annual descriptive statistics for selected data series</title></caption>
        </table-wrap>
        <p>For the sample of 3,285 new corporate debt securities issued between January 3, 1983 and June 30, 1993, with known maturity dates and yields which could be matched by term to maturity with a constant maturity Treasury rate on the date of issue. This sample does not include any convertible, original-issue-discount, ﬂoating rate or foreign issues. Year is the year of issue; N is the number of observations in that year; Yield is the measured yield-atissue of the new security, in percent; CMYLD is the constant maturity Treasury rate for the same term as the new issue on the issuing date; YOT is (Yield - CMYLD); CMQSYLD is the average yield on Moody’s Aaa Corporate Bond Index (weekly) for the issue date minus CMYLD; GROSS is the total size of the security issue in millions of dollars. Variable Name</p>
        <p>Year</p>
        <p>Mean St. Dev. Min. Max. Mean St. Dev. Min. Max. Mean St. Dev. Min. Max. Mean St. Dev. Min. Max. Mean St. Dev. Min. Max. Mean St. Dev. Min. Max. Mean St. Dev. Min. Max. Mean St. Dev. Min. Max. Mean St. Dev. Min. Max. Mean St. Dev. Min. Max. Mean St. Dev. Min. Max.</p>
        <p>Yield (%)</p>
        <p>CMYLD (%)</p>
        <p>YOT (%)</p>
        <p>CMQSYLD (%)</p>
        <p>GROSS ($M)</p>
        <table-wrap id="tbl3">
          <label>Table 3</label>
          <caption><title>Annual security issues by type of issues</title></caption>
          <table>
            <thead>
              <tr>
                <th colspan="7">For the sample of 3,285 new corporate debt securities issued between January 3, 1983</th>
              </tr>
              <tr>
                <th colspan="6">and June 30, 1993, with known maturity dates and yields which could be matched</th>
                <th></th>
              </tr>
              <tr>
                <th colspan="7">by term to maturity with a constant maturity Treasury rate on the date of issue. This</th>
              </tr>
              <tr>
                <th colspan="7">sample does not include any convertible, original-issue-discount, ﬂoating rate or</th>
              </tr>
              <tr>
                <th colspan="7">foreign issues. Note: categories here are not mutually exclusive. Year is the year</th>
              </tr>
              <tr>
                <th colspan="7">of issue; N is the number of observations in that year; EURO is a dummy variable</th>
              </tr>
              <tr>
                <th colspan="7">indicating whether the security was issued in a foreign market by a domestic ﬁrm;</th>
              </tr>
              <tr>
                <th colspan="7">SFDUM is a dummy variable which is 0 if a sinking fund provision exists for the</th>
              </tr>
              <tr>
                <th colspan="7">issue; SECDUM is a dummy variable indicating that the issue is secured (mortgage,</th>
              </tr>
              <tr>
                <th colspan="7">lease or equipment trust related); CRFDUM is a dummy variable which is 1 if the call</th>
              </tr>
              <tr>
                <th colspan="7">or refunding date is included in the original issue announcement; SPLIT is a dummy</th>
              </tr>
              <tr>
                <th colspan="7">variable which is zero if the issue’s Moody’s rating is equivalent to the rating assigned</th>
              </tr>
              <tr>
                <th colspan="2">by Standard and Poors.</th>
                <th colspan="5"></th>
              </tr>
              <tr>
                <th colspan="4"></th>
                <th colspan="2">Variable Name</th>
                <th></th>
              </tr>
              <tr>
                <th>Year</th>
                <th>N</th>
                <th>EURO</th>
                <th>SFDUM</th>
                <th>SECDUM</th>
                <th>CRFDUM</th>
                <th>SPLIT</th>
              </tr>
            </thead>
            <tbody>
              <tr>
                <td>1983</td>
                <td>127</td>
                <td>6</td>
                <td>15</td>
                <td>64</td>
                <td>87</td>
                <td>73</td>
              </tr>
              <tr>
                <td>1984</td>
                <td>116</td>
                <td>1</td>
                <td>12</td>
                <td>44</td>
                <td>62</td>
                <td>74</td>
              </tr>
              <tr>
                <td>1985</td>
                <td>251</td>
                <td>33</td>
                <td>23</td>
                <td>61</td>
                <td>159</td>
                <td>142</td>
              </tr>
              <tr>
                <td>1986</td>
                <td>472</td>
                <td>29</td>
                <td>44</td>
                <td>151</td>
                <td>255</td>
                <td>291</td>
              </tr>
              <tr>
                <td>1987</td>
                <td>302</td>
                <td>10</td>
                <td>46</td>
                <td>81</td>
                <td>149</td>
                <td>176</td>
              </tr>
              <tr>
                <td>1988</td>
                <td>265</td>
                <td>17</td>
                <td>28</td>
                <td>56</td>
                <td>135</td>
                <td>151</td>
              </tr>
              <tr>
                <td>1989</td>
                <td>210</td>
                <td>7</td>
                <td>20</td>
                <td>54</td>
                <td>80</td>
                <td>106</td>
              </tr>
              <tr>
                <td>1990</td>
                <td>169</td>
                <td>1</td>
                <td>7</td>
                <td>47</td>
                <td>40</td>
                <td>76</td>
              </tr>
              <tr>
                <td>1991</td>
                <td>323</td>
                <td>14</td>
                <td>5</td>
                <td>61</td>
                <td>49</td>
                <td>144</td>
              </tr>
              <tr>
                <td>1992</td>
                <td>627</td>
                <td>16</td>
                <td>11</td>
                <td>211</td>
                <td>144</td>
                <td>315</td>
              </tr>
              <tr>
                <td>1993</td>
                <td>425</td>
                <td>4</td>
                <td>4</td>
                <td>151</td>
                <td>123</td>
                <td>230</td>
              </tr>
              <tr>
                <td>Totals</td>
                <td>3,287</td>
                <td>138</td>
                <td>215</td>
                <td>981</td>
                <td>1,283</td>
                <td>1,778</td>
              </tr>
            </tbody>
          </table>
        </table-wrap>
        <p>For the sample of 3,285 new corporate debt securities issued between January 3, 1983 and June 30, 1993, with known maturity dates and yields which could be matched by term to maturity with a constant maturity Treasury rate on the date of issue. This sample does not include any convertible, original-issue-discount, ﬂoating rate or foreign issues. Note: categories here are not mutually exclusive. Year is the year of issue; N is the number of observations in that year; EURO is a dummy variable indicating whether the security was issued in a foreign market by a domestic ﬁrm; SFDUM is a dummy variable which is 0 if a sinking fund provision exists for the issue; SECDUM is a dummy variable indicating that the issue is secured (mortgage, lease or equipment trust related); CRFDUM is a dummy variable which is 1 if the call or refunding date is included in the original issue announcement; SPLIT is a dummy variable which is zero if the issue’s Moody’s rating is equivalent to the rating assigned by Standard and Poors. Variable Name Year</p>
      </sec>
    </sec>
    <sec id="sec8">
      <title>EURO</title>
    </sec>
    <sec id="sec9">
      <title>SFDUM</title>
    </sec>
    <sec id="sec10">
      <title>SECDUM</title>
    </sec>
    <sec id="sec11">
      <title>CRFDUM</title>
    </sec>
    <sec id="sec12">
      <title>SPLIT</title>
      <sec id="sec12-1">
        <title>Totals</title>
        <p>4. Findings and Discussion A) A Simple Model The second column of Table 4 shows the results of an initial regression model (Model 1A) ﬁt to the full comparable data set.13 The maturity-matched</p>
        <p>The techniques and speciﬁcations in this section were originally applied to the full 4,676 observations as well as those with directly comparable maturity matches (3,293 observations with outliers). For the full data set, YOT was calculated as the issue yield minus the daily yield on a long-term Treasury index; the RHS spread variable used was the yield on Moody’s Aaa Corporate Bond index less the daily Treasury bond index yield. These regressions never produced a signiﬁcant coefﬁcient for the spread variable, even when all different lagged values of spread and volatility (standard deviation or meanabsolute-deviation) were estimated in turn. A full interest rate level measure on the RHS didn’t improve any of these models over the speciﬁcations reported, either.</p>
        <p>spread measure, issue term, volatility (measured by mean absolute deviation) and four of ﬁve bond class coefﬁcients are signiﬁcant at the 0.01 acceptance level, with the remaining rating class (Aaa) dummy signiﬁcant at the 0.05 levels. The size factor and the call/refund dummy are signiﬁcant at the 0.10 levels. The intercept, which corresponds to the A rating class, is not different from zero. An F-test for overall signiﬁcance rejects the null hypothesis at the 0.01 level.14 Initial results (not presented) were sensitive to the choice of the omitted rating class. Early speciﬁcations of the model using Aaa as the omitted class were designed to make interpretation of the difference between lower yields and the quality spread variable clearer, but these models showed high levels of multicollinearity between the size variable and several bond classes.15 When the omitted class was changed to B, these problems disappeared, but several of the other regressors lost signiﬁcance. Finally, the A class was chosen due to its large number of observations relative to the other classes and the balanced results it provided.16 In addition to the original speciﬁcation used in Model 1A, the model was estimated for measured values of the quality spread and volatility variables observed one and two weeks prior to the issue date (these results are not presented). These models were no more signiﬁcant or intuitive than the base case. The model was also tested using one and two-week lagged values of the prior 26-week standard deviations in place of the mean-absolute-deviation term; there was a slight decrease in signiﬁcance for several regressors, and the overall explanatory power dropped. As shown by its retention in Model 1A, the TERM variable performs better than its natural log, although GROSS does not. After adjusting the omitted class, the regressor, variance inﬂation factors, in Model 1A dropped to near one.17 In addition, the model’s condition number,</p>
        <p>Models 1B, 2 and 3 are also signiﬁcant at the 1% level. Aaa was originally made the omitted class to avoid problems with the lack of negative splits associated with this class. A Standard and Poors security rating can never be higher than Aaa, so there would never be any observations of an interaction term between the class Aaa and the split categories which represent one subclass rating (e.g., Aa+ versus Aa) higher than the current class, two classes higher, and three classes higher. This speciﬁcation problem suggests that the overall relationship between default risk and quality spreads not likely to be linear. Even so, the relationship between individual rating classes and yield spreads may still be linear. The VIF option in SAS PROC REG produces variance inﬂation factors, which are the inverse of the tolerance for each regressor. Freund and Littell (1991) note that these should be below the reciprocal of one minus the r-squared for the overall regression, since the VIF is reciprocal of one minus the r-squared for a regression of each regressor on the others; a high VIF indicates that the other independent variables are more closely related to the variable in question than to the dependent variable. For this initial regression, the suggested threshhold value is 3.352. Freund and Littell also note that other authors consider 10 to be an acceptable threshhold value.</p>
        <p>formerly above forty, dropped to below 25.18 Multicollinearity, obviously present in each of these models, was not necessarily harmful to the results. The initial model was tested for the presence of inﬂuencial outlier values. Eight observations (out of 3,293) were found to be extreme and were dropped from the data set used to estimate the remaining regressions. Dropping these data points increased the ﬁt of the overall regression and increased the signiﬁcance of most of the coefﬁcients. This is Model 1B in Table IV. In addition, the coefﬁcient on EURO was found to be negative and signiﬁcantly related to the YOT at the 0.05 level.19 These eliminations improved the ﬁt of Models 2 and 3 as well. The error variances were examined for heteroskedasticity using GoldfeldQuandt tests as described in Kennedy (1992) and Pindyk and Rubenfeld (1981). Tests were performed for CMQSYLD, TERM and LNGROSS as suspected related regressors; only CMQSYLD marginally rejected the null. A weighted least squares performed to correct this relationship only increased the GoldfeldQuandt test statistic, which suggests that there may be a relevant variable left out of the model.20 The most likely omitted variable is one which conveys information about the general level of interest rates. As noted above, most prior models have incorporated some value of contemporaneous interest rates to increase their explanatory power. A measure of the Moody’s Aaa Corporate Bond index yield minus the rate on a daily index of long-term government bonds was added as a regressor; the Aaa Corporate Bond index yield and the Treasury bond index yield were each added separately in turn. None of these changes lower the level</p>
        <p>The condition number is reported in SAS using the COLLIN option with PROC REG. This number is given along with the variance proportion for each independent variable. Freund &amp; Littell (1991) suggest that a condition number greater than thirty may indicate a problem with multicollinearity. A high condition number for a given eigenvalue combined with variance proportions of over 0.5 for any regressors indicates that these regressors may cause collinearity problems. In the initial screen of Model 1A (with outliers), the model was tested without the LNGROSS term to attempt to correct for a multicollinearity problem according to a high variance proportion and a large condition number. No signiﬁcant changes resulted. Diagnostic values of the hat matrix, RSTUDENT, COVRATIO, DFFITS, and DFBETAS were generated using the INFLUENCE model option available in SAS PROC REG. These were output to a separate data set and tested for cutoff values as described in SAS/STAT User’s Guide, Version 6 (1989) using summary and screening procedures, for ﬁfteen parameters estimated (p) and the number of observations [n]. DFBETAS for this model were inspected individually. In all cases, the deleted observations had RSTUDENT values greater than two in absolute value and H values greater than [2*p/n]. None of the observations had extreme values of DFBETAS, COVRATIO, or DFFITS. The reweighting in this case consisted of dividing all observations by CMQSYLD, as suggested by Pindyk and Rubenfeld (1981).</p>
        <p>of heteroskedasticity in the model, nor does the addition of the actual constant maturity Treasury yield on an issue-by-issue basis (CMYLD).21 22 For Model 1B, F-tests are used to evaluate the joint impact of the set of rating class coefﬁcients; these are signiﬁcantly different from zero as a group (including the intercept) at the 0.01 level. The coefﬁcient for the Aaa class is not signiﬁcantly different from that of the Aa class, and the Aa class is not different from the A class (intercept). The ﬁrst of these results conﬁrms the ﬁndings of BLMT (1985) regarding the explanatory power of different rating class categories. The remaining adjacent class coefﬁcients are different from each other at the 1% level, consistent with prior research. These results suggest that the default risk distinction is not as obvious between higher rating classes than between ratings overall. The coefﬁcients for CRFDUM (the existence of call or refunding provisions) and EURO (overseas issue) are both different from zero at the 5% level in Model 1B. The coefﬁcients for SECDUM (secured issues) and SFDUM (sinking fund) are not signiﬁcantly related to yield spreads in this sample. These four relationships hold for each of the models discussed below as well. B) More Complex Speciﬁcations From Table 4, it is clear that the ratings categories explain a great deal of the variance in an issue’s YOT, but the SPLIT designator has no statistical inﬂuence on the model results. In Model 2, the split category variable is replaced by six dummy variables which indicate the direction and the magnitude of the split; those securities with equal Moody’s and Standard and Poors ratings make up the omitted class.23 These results are shown in column four of Table 4. The six split categories represent one, two or three numerical values away from the Moody’s rating in either the positive (P) or negative (N) direction. All of the positive split coefﬁents are individually different from zero at the 0.05 level and directly related to YOT, indicating a direct relationship between a higher Moody’s rating and an issue’s yield spread in the subclass categories</p>
        <p>Both Breusch-Pagan and White tests, as described by Kennedy (1992), were used to conﬁrmed the general nature of the unequal error variance in the original model. Another weighted least squares procedure, also from Kennedy, was estimated by weighting the observations by the square root of the estimated error variance from the original regression to produce GLS estimators. A Goldfeld-Quandt test on this regression also indicated signiﬁcant heteroskedasticity at the prior levels. For this reason, the remaining analysis and extension was done on the original equation and additions to it; an extension of this paper would be to re-estimate these models using an appropriate specialized panel data approach. Durbin-Watson statistics were tested to assess the level of autocorrelation in the error terms. These are close to 2 for all models tested, and the ﬁrst-order autocorrelations calculated for residuals are generally below 0.13. For the four models presented, the ﬁrst-order rhos are less than 0.10. Issues showing differences of +/- 4 and 5 revised categories were deleted from the sample because there were few in each class. A total of approximately forty observations were lost for this reason.</p>
        <p>higher by Standard and Poor’s) is different from zero at the 10% level and inversely related to measured YOT. F-tests on the subset of coefﬁcients for the split categories indicate the coefﬁcients are signiﬁcantly different from zero, as a group. In addition, the positive split group is jointly different from the intercept term; the negative splits, indicating higher Standard and Poors ratings for particular issues, are not. Some of this difference may be due to the presence of more positive split observations in the later years of the sample. Of the six intra-group boundaries, only the coefﬁcients for a positive three and a positive two split are signiﬁcantly different from each other. The rating classes are still signiﬁcantly different from one another in Model 2. An F-test conﬁrms that the same class relationships hold from Model 1B. Evidently, the basic relationship connecting splits, ratings and yields is not completely described by this speciﬁcation. The model results suggest that split issues generally have higher yield spreads, but that this higher spread may be due to the impact of Moody’s versus Standard and Poor’s as the rater assigning the higher issue. In other words, split ratings may not be symmetric with respect to the rater which assigned the higher rating. Table 5 contains the distribution of split magnitudes across the six broad classes of bond rating and each of the seven subclasses for each issue year. As noted above, Aaa bonds cannot have any negative split observations. Split magnitude and direction refer to the Standard and Poor’s “revised” rating subtracted from the Moody’s revised rating. Nineteen sub-categories (such as Aa1, Aa2 and Aa3 for Moody’s and AA+, AA and AA- for Standard and Poor’s) were initially developed from the data. Model 3 was created to exploit the relationships evident in Table 5. This model adds interaction terms for split magnitudes and directions and speciﬁc ratings classes for those interactions which had thirty or more observations over the sample period.24 As shown in Table VI, the positive split coefﬁcients lose most of their explanatory power compared with Model 2, though an F-test indicates that the positive split interaction estimates as a group are still different from zero at the 0.01 level.25 The positive three-split coefﬁcient remains different from zero at the 0.05 level. The P1BAA coefﬁcient is positively related to issue yield spread and different from zero, as would be expected from Model 2. Although only one of the Model 2 negative split terms is signiﬁcant, when these observations are grouped by rating class the coefﬁcients for N2BA, N1BA, and N1B are inversely related to YOT and signiﬁcant at the 0.01 level. In addition, the coefﬁcients of N1B and N1BA are different from the model intercept at the 0.01 level, and the P1BAA term is different from the intercept at the 0.10 level. None of the adjacent interactions were signiﬁcantly different from each other.</p>
        <p>The same model was estimated using all interactions terms having existing observations; the signiﬁcance of the model coefﬁcients and the model’s overall explanatory power were no different. Coefﬁcients found using all interactions which had observed values were not signiﬁcantly different from zero as a group. This may be due to contextual outliers not identiﬁed before due to the limited information used by the original</p>
        <table-wrap id="tbl4">
          <label>Table 4</label>
          <caption><title>Initial regression results</title></caption>
        </table-wrap>
        <p>The model explains new security yield off-Treasury measured with an exact maturity match constant maturity Treasury rate. CMQSYLD is the difference between Moody’s Aaa Corporate Bond Index and the matchedmaturity CM rate; LNGROSS is the natural log of the issue size (in millions); TERM is the term to maturity of the issue (in years); DMAD1WLG is the mean absolute deviation in the spread between Moody’s Aaa index yield (weekly) and an index of long-term (10+ years) government bonds (weekly) for the 26 weeks prior to the issue date; SFDUM, CRFDUM, SECDUM, EURO and SPLIT are 0/1 dummy variables for the existence of a sinking fund, a known call or refund date, a secured issue, a euro issue, and a split between the ratings given the issue by Moody’s and S&amp;P. AAACL through BCL are dummy variables for the general ratings class for the issue’s Moody’s rating, with A (1,280 obs.) being the omitted class. MDIFN3 through MDIFP3 are dummy variables for the magnitude and sign of the difference between the issue’s Moody’s rating and its Standard &amp; Poors rating, with 0 (no difference) being the omitted class. Model 1A was estimated before the elimination of 8 outlier observations, as indicated by values calculated by the INFLUENCE option in SAS PROC REG. Model 1B is identical to 1A with this exception. All four models were signiﬁcant at the 0.01 level. *** indicates individual coefﬁcient signiﬁcance at the 0.01 level; ** indicates signiﬁcance at the 0.05 level, and * indicates signiﬁcance at the 0.10 level. Regressor</p>
        <p>Model 1A (w/ outliers)</p>
        <p>Model 1B</p>
        <p>Model 2</p>
        <p>Intercept</p>
        <p>CMQSYLD LNGROSS TERM DMAD1WLG SFDUM CRFDUM SECDUM EURO SPLIT AAACL AACL BAACL BACL BCL MDIFN3 MDIFN2 MDIFN1 MDIFP1 MDIFP2 MDIFP3 R-square Adj. R-square Number of obs.:</p>
        <table-wrap id="tbl5">
          <label>Table 5</label>
          <caption><title>Reﬁned split model regression</title></caption>
        </table-wrap>
        <p>The model explains new security yield off-Treasury measured with an exact maturity match constant maturity Treasury rate. CMQSYLD is the difference between Moody’s Aaa Corporate Bond Index and the matched-maturity CM rate; LNGROSS is the natural log of the issue size (in millions); TERM is the term to maturity of the issue (in years); DMAD1WLG is the mean absolute deviation in the spread between Moody’s Aaa index yield (weekly) and an index of long-term (10+ years) government bonds (weekly) for the 26 weeks prior to the issue date; SFDUM, CRFDUM, SECDUM, and EURO are 0/1 dummy variables for the existence of a sinking fund, a known call or refund date, a secured issue, and a euro issue. AAACL through BCL are dummy variables for the general ratings class for the issue’s Moody’s rating, with A (1,280 obs.) being the omitted class. MDIFN3 through MDIFP3 are dummy variables for the magnitude and sign of the difference between the issue’s Moody’s rating and its Standard &amp; Poors rating, with 0 (no difference) being the omitted class. N1AA through P1B are interaction terms for the ratings class and the magnitude and sign of the split, for those categories which had more than 30 observations across the full sample period. The overall model is signiﬁcant at the 0.01 level. *** indicates individual coefﬁcient signiﬁcance at the 0.01 level; ** indicates signiﬁcance at the 0.05 level; * indicates signiﬁcance at the 0.10 level. Regressor</p>
        <p>Model 3</p>
        <p>Regressor</p>
        <p>Model 3</p>
        <p>Intercept</p>
        <p>N1AA</p>
        <p>CMQSYLD LNGROSS TERM DMAD1WLG SFDUM CRFDUM SECDUM EURO AAACL AACL BAACL BACL BCL MDIFN3 MDIFN2 MDIFN1 MDIFP1 MDIFP2 MDIFP3 R-square: 0.7367:</p>
        <p>P1AA N1BAA P1BAA P2BAA N2BA N1BA P1BA P2BA N1B P1B</p>
        <p>Adj. R-square: 0.7342:</p>
        <p>Number of obs.: 3,285</p>
        <p>The main conclusion implied by the Model 3 results is that additional information provided by the general rating classes in conjunction with the magnitude and direction of a rating split adds to the overall explanatory power of the model, given an adequate number of issues for each interaction tested. In general, the results of Model 3 suggest that the relationship between splits, new issue yield spreads and the more highly rating agency may depend on the direction and size of the split as well as the broad rating class assigned to the security. Separately, the impact of splits appears to be smaller for lower credit rating classes, consistent with the idea that default risk is not priced in equal intervals across rating classes. 5. Conclusion This study presents evidence conﬁrming new ﬁndings: (1) the ability of credit ratings to explain differing yield spreads on new issues; (2) the higher yield premiums are paid by issues with split ratings; and (3) the need to recognize the interactions between ratings and split magnitude and direction in any model of new issue yields off-Treasury. Several of the results also suggest that the relationship between spreads and split ratings may not be symmetric across issues rated higher by Standard and Poor’s and those rated higher by Moody’s. The data set developed for this study is more comprehensive in the number of issues and issue dates than data used in prior research on these questions. A natural extension of this work would involve reducing the potential ﬁrm, industry and time-series effects that remain uncorrected in the data. Author statement: Timothy B. Michael is a professor in the School of Business, University of Houston, Clear Lake. He may be reached at michael@uhcl.edu. He wishes to record his appreciation to the journal editors for the review of this article and also their editing of the article to incorporate the changes. The responsibility for remaining errors rests with the author.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <title>References</title>
      <ref id="ref1"><mixed-citation>Billingsley, Randall S., Robert E. Lamy, M. Wayne Marr, and G. Rodney Thompson. (1985). Split ratings and bond reoffering yields. Financial Management 14(2): 59-65.</mixed-citation></ref>
      <ref id="ref2"><mixed-citation>Brigham, Eugene F. and Louis C. Gapenski (1994). Financial Management: Theory and Practice. Fort Worth, Texas, Dryden Press.</mixed-citation></ref>
      <ref id="ref3"><mixed-citation>Ederington, Louis H., Jess B. Yawitz and Brian E. Roberts (1987). The informational content of bond ratings. Journal of Financial Research 10(3): 211-226.</mixed-citation></ref>
      <ref id="ref4"><mixed-citation>Freund, Rudolf J. and Ramon C. Littell (1991). SAS System for Regression, Second Edition. Cary, North Carolina, SAS Institute, Inc.</mixed-citation></ref>
      <ref id="ref5"><mixed-citation>Greene, William H. (1993). Econometric Analysis, Second Edition. Englewood Cliffs, New Jersey, Prentice-Hall.</mixed-citation></ref>
      <ref id="ref6"><mixed-citation>Guedes, Jose and Tim Opler (1995). The determinants of the maturity of corporate debt issues. Working Paper: Ohio State University.</mixed-citation></ref>
      <ref id="ref7"><mixed-citation>Hsueh, L. Paul and P.R. Chandy (1989). An examination of the yield spread between insured and uninsured issues. Journal of Financial Research 12(3): 235-244.</mixed-citation></ref>
      <ref id="ref8"><mixed-citation>Kao, Chihwa and Chunchi Wa (1994). A re-examination of the impact of credit ratings and economic factors on state bond yields. Review of Quantitative Finance and Accounting 4: 59-78.</mixed-citation></ref>
      <ref id="ref9"><mixed-citation>Kaplan, Robert S. and Gabriel Urwitz (1979). Statistical models of bond ratings: a methodological inquiry. Journal of Business 52(2): 231-261.</mixed-citation></ref>
      <ref id="ref10"><mixed-citation>Kennedy, Peter (1992). A Guide to Econometrics, Third Edition. Cambridge, Massachusetts, MIT Press.</mixed-citation></ref>
      <ref id="ref11"><mixed-citation>Kidwell, David S., M. Wayne Marr and G. Rodney Thompson (1984). SEC rule 415: the ultimate competitive bid. Journal of Financial and Quantitative Analysis 19(2): 183-195.</mixed-citation></ref>
      <ref id="ref12"><mixed-citation>Kidwell, David S., M. Wayne Marr, and Joseph P. Ogden (1989). The effect of a sinking fund on the reoffering yields of new public utility bonds. Journal of Financial Research 12(1), 1-13.</mixed-citation></ref>
      <ref id="ref13"><mixed-citation>Liu, Pu and William T. Moore (1987). The impact of split bond ratings on risk premia. Financial Review 22(1): 71-85.</mixed-citation></ref>
      <ref id="ref14"><mixed-citation>Liu, Pu and Anjan V. Thakor (1984). Interest yields, credit ratings, and economic characteristics of state bonds: an empirical analysis. Journal of Money, Credit, and Banking 16(3): 344-350.</mixed-citation></ref>
      <ref id="ref15"><mixed-citation>Perry, Larry G., Pu Liu and Dorla A. Evans (1988). Modiﬁed bond ratings: Further evidence on the effect of split ratings on corporate bond yields. Journal of Business Finance &amp; Accounting 15(2): 231-241.</mixed-citation></ref>
      <ref id="ref16"><mixed-citation>Pindyck, Robert S. and Daniel L. Rubinfeld (1981). Econometric Models and Econometric Forecasts, Second Edition. U.S.A.: McGraw-Hill.</mixed-citation></ref>
      <ref id="ref17"><mixed-citation>Reiter, Sara A. and David A. Ziebart (1991). Bond yields, ratings, and ﬁnancial information: evidence from public utility issues. The Financial Review 26(1): 45-73.</mixed-citation></ref>
      <ref id="ref18"><mixed-citation>SAS Institute, Inc. (1989). SAS/STAT User’s Guide, Version 6, Volume 2. Cary, North Carolina, SAS Institute, Inc.</mixed-citation></ref>
      <ref id="ref19"><mixed-citation>Sorensen, Eric H. (1979). The impact of underwriting method and bidder competition upon corporate bond interest cost. The Journal of Finance 34(4): 863-870.</mixed-citation></ref>
      <ref id="ref20"><mixed-citation>Sorensen, Eric H. (1982). On the seasoning process of new bonds: Some are more seasoned than others. Journal of Financial and Quantitative Analysis 17(2): 195-208.</mixed-citation></ref>
      <ref id="ref21"><mixed-citation>Zivney, Terry L., William J. Bertin and Khalil M. Torabzadeh (1993). A reexamination of the investment performance of junk bonds. Quarterly Journal of Business and Economics 32(2), 78-97.</mixed-citation></ref>
    </ref-list>
  </back>
</article>
