<?xml version="1.0" encoding="utf-8"?>
<rfc xmlns:xi="http://www.w3.org/2001/XInclude"
     ipr="trust200902"
     docName="draft-arsentev-repository-availability-reporting-00"
     category="info"
     submissionType="independent"
     tocInclude="true"
     tocDepth="3"
     sortRefs="true"
     symRefs="true"
     version="3">
  <front>
    <title abbrev="Repository Availability Reporting">Reporting the Availability of Referenced Software and Model Repositories</title>
    <seriesInfo name="Internet-Draft" value="draft-arsentev-repository-availability-reporting-00" stream="independent"/>
    <author fullname="Evgenii Arsentev" initials="E." surname="Arsentev">
      <organization>Independent</organization>
      <address>
        <email>hello@arsentev.ai</email>
        <uri>https://arsentev.ai/</uri>
      </address>
    </author>
    <date/>
    <keyword>link rot</keyword>
    <keyword>software citation</keyword>
    <keyword>repository</keyword>
    <keyword>measurement</keyword>
    <keyword>persistent identifier</keyword>
    <abstract>
<t>Papers, catalogues, model cards and tool lists point to code and model repositories by URL. Such repositories can be deleted, made private, blocked or simply stop changing, and reports of "link rot" or "project survival" often mix these different events into one number. This document defines how to classify each observation of a referenced repository, when a repository counts as unavailable, how to report inactivity separately from unavailability, and a small JSON report object. It also recommends citing a persistent identifier or an archived copy next to the repository URL.</t>
    </abstract>
  </front>
  <middle>
<section anchor="intro"><name>Introduction</name>
<t>Lists of software and models, including curated catalogues of AI tools, cite repositories on hosting platforms such as GitHub and Hugging Face by URL. A URL can stop resolving for several reasons, and a project can remain reachable while nobody changes it any more.</t>
<t>Platforms answer a missing repository in different ways. A platform may return 404 (<xref target="RFC9110" section="15.5.5"/>) for one missing repository and 401 (<xref target="RFC9110" section="15.5.2"/>) for another. The status 451 (<xref target="RFC7725"/>) is used when access is blocked for legal reasons. Single checks are noisy, because a request can fail for reasons unrelated to the repository.</t>
<t>The goal of this document is to make the definition behind every reported availability number explicit, so that numbers from different studies can be compared. This document does not define how to archive repositories, does not rank projects, and does not say which projects should be cited.</t>
</section>
<section anchor="conventions-and-terminology"><name>Conventions and Terminology</name>
<t>The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "NOT RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in BCP 14 <xref target="RFC2119"/> <xref target="RFC8174"/> when, and only when, they appear in all capitals, as shown here.</t>
<t>This document uses the following terms:</t>
<dl newline="false" spacing="normal"><dt>referenced repository:</dt><dd>a repository URL that appears in a list, catalogue or document being studied.</dd><dt>selection date:</dt><dd>the date the repository entered the list being studied.</dd><dt>snapshot:</dt><dd>one check of all referenced repositories made at one time.</dd><dt>horizon:</dt><dd>a number of weeks after the selection date at which availability is reported.</dd></dl>
</section>
<section anchor="classifying-observations"><name>Classifying Observations</name>
<t>Each snapshot records, for every referenced repository, one of the following states:</t>
<dl newline="false" spacing="normal"><dt>available:</dt><dd>the repository page or API answered with success.</dd><dt>missing:</dt><dd>the platform answered with a status the report lists as "repository missing" for that platform (for example 404 or 451 on one platform, 401 or 404 on another).</dd><dt>error:</dt><dd>any other failure, such as a timeout or a server error. An error is not evidence that the repository is gone.</dd></dl>
<t>The report MUST list, per platform, which status codes it treats as missing. A repository MUST NOT be counted as unavailable after a single missing observation. The report MUST state how many consecutive missing snapshots it requires.</t>
<t>A repository that becomes available again after being counted as unavailable is reported as a return. It is not deleted from the data.</t>
</section>
<section anchor="inactivity-is-a-separate-count"><name>Inactivity Is a Separate Count</name>
<t>Inactivity means no change to the repository for a stated number of days, for example no push for 90 days. Inactivity and archiving by the owner are reported separately from unavailability.</t>
<t>A composite count that adds inactivity to unavailability MUST be labelled as composite.</t>
<t>A fixed inactivity threshold produces a step in a composite curve once observed projects pass that threshold. Such a step is a property of the rule, not evidence that projects disappeared.</t>
</section>
<section anchor="reporting-over-time"><name>Reporting over Time</name>
<t>Availability is reported at stated horizons counted from each repository's selection date, not from the first snapshot.</t>
<t>The report gives the estimator used (for example Kaplan-Meier) and the number of repositories still under observation at each horizon. The report SHOULD NOT report horizons where very few repositories remain under observation.</t>
<t>The report states the selection rule of the list, because a result about one list does not describe a whole platform.</t>
</section>
<section anchor="report-object"><name>Report Object</name>
<t>The results of a study can be carried in a JSON object (<xref target="RFC8259"/>). The object carries the observation window, the per-platform missing status codes, the consecutive-snapshot rule, and per-horizon availability with the number of repositories under observation. The example in the appendix uses illustrative numbers, not measurements.</t>
<t>The report is a JSON object <xref target="RFC8259"/> with the following members.</t>
<dl newline="true" spacing="normal">
<dt>list</dt><dd>Object, REQUIRED, with members "name" (string naming the list or catalogue studied), "selection_rule" (string describing how entries entered the list) and "entries" (non-negative integer).</dd>
<dt>window</dt><dd>Object, REQUIRED, with members "first_snapshot" and "last_snapshot" (each a full-date as defined in <xref target="RFC3339"/>) and "snapshots" (non-negative integer).</dd>
<dt>platforms</dt><dd>Array, REQUIRED, one object per hosting platform, with members "platform" (string), "observed" (non-negative integer) and "missing_status" (array of integer HTTP status codes treated as missing).</dd>
<dt>consecutive_missing</dt><dd>Integer of at least 2, REQUIRED. Number of consecutive missing snapshots after which a repository is counted as unavailable.</dd>
<dt>unavailable</dt><dd>Non-negative integer, REQUIRED. Repositories counted as unavailable at least once.</dd>
<dt>returned</dt><dd>Non-negative integer, REQUIRED. Repositories counted as unavailable that were later available again.</dd>
<dt>inactive</dt><dd>Object, OPTIONAL, with members "rule" (string, for example "no push for 90 days") and "count" (non-negative integer). Never added to "unavailable".</dd>
<dt>estimator</dt><dd>String, REQUIRED, for example "kaplan-meier".</dd>
<dt>horizons</dt><dd>Array, REQUIRED, one object per reported horizon, with members "weeks" (positive integer, counted from each repository's selection date), "available" (number between 0 and 1) and "at_risk" (non-negative integer, repositories still under observation at that horizon).</dd>
</dl>
<t>Members not defined here MAY be added; consumers MUST ignore members they do not understand.</t>

</section>
<section anchor="citing-repositories"><name>Citing Repositories</name>
<t>Documents that cite a repository SHOULD also give a persistent identifier (for example a DOI of an archived release) or the URI of an archived copy, such as a Memento (<xref target="RFC7089"/>), next to the repository URL.</t>
<t>The repository URL alone tells a later reader where the project was, not what was cited.</t>
</section>
<section anchor="operational-experience"><name>Operational Experience</name>
<t>One curated radar of AI tools selected 757 entries between 11 June and 31 October 2026. 733 GitHub and Hugging Face projects were observed in 50 daily snapshots from 12 September to 31 October 2026. The metric was fixed on 5 October 2026, before analysis.</t>
<t>Unavailability was defined as 404 or 451 on GitHub and 401 or 404 on Hugging Face, two snapshots in a row. 23 projects became unavailable and 5 of them later came back.</t>
<t>Kaplan-Meier availability was 96.7% at week 4, 94.6% at week 8 and 93.0% at week 12 after selection, roughly one project in 14 lost by week 12.</t>
<t>Inactivity was more common than removal: 67 projects had no push for 90 days, against 23 that became unavailable. A composite curve that included inactivity dropped sharply after week 12, and that drop came from the 90-day rule.</t>
<t>These numbers come from one radar with one selection rule and do not describe GitHub or Hugging Face as a whole. The study is published with DOI 10.5281/zenodo.24101933 <xref target="SURVIVAL"/>.</t>
</section>
<section anchor="security"><name>Security Considerations</name>
<t>Repeated automated checks of many repositories can trigger platform rate limits. Checks SHOULD respect the platform's published limits.</t>
<t>A repository URL that resolves again after a gap may now hold different content under the same name. Reports that record returns SHOULD note that content was not compared unless it was.</t>
</section>
<section anchor="privacy"><name>Privacy Considerations</name>
<t>The report carries counts and status codes only. It SHOULD NOT name individual repository owners.</t>
<t>Small counts per platform or per month can still point to a specific project. Operators SHOULD consider this before publishing per-cell numbers.</t>
</section>
<section anchor="iana"><name>IANA Considerations</name>
<t>This document has no IANA actions.</t>
</section>
  </middle>
  <back>
    <references>
      <name>References</name>
      <references>
        <name>Normative References</name>
        <xi:include href="https://bib.ietf.org/public/rfc/bibxml/reference.RFC.2119.xml"/><xi:include href="https://bib.ietf.org/public/rfc/bibxml/reference.RFC.3339.xml"/><xi:include href="https://bib.ietf.org/public/rfc/bibxml/reference.RFC.8174.xml"/><xi:include href="https://bib.ietf.org/public/rfc/bibxml/reference.RFC.8259.xml"/><xi:include href="https://bib.ietf.org/public/rfc/bibxml/reference.RFC.9110.xml"/>
      </references>
      <references>
        <name>Informative References</name>
        <xi:include href="https://bib.ietf.org/public/rfc/bibxml/reference.RFC.7725.xml"/><xi:include href="https://bib.ietf.org/public/rfc/bibxml/reference.RFC.7089.xml"/>
        <reference anchor="SURVIVAL" target="https://doi.org/10.5281/zenodo.24101933">
          <front>
            <title>How Long Do Trending AI Projects Stay Available and Maintained? Survival of 733 GitHub and Hugging Face Projects Picked by a Weekly Radar (June-October 2026)</title>
            <author fullname="Evgenii Arsentev" initials="E." surname="Arsentev"/>
            <date year="2026" month="November"/>
          </front>
          <seriesInfo name="DOI" value="10.5281/zenodo.24101933"/>
          <refcontent>Zenodo</refcontent>
        </reference>
      </references>
    </references>
<section anchor="example"><name>Example Report</name>
<t>The numbers in this example are illustrative and are not measurements.</t>
<sourcecode type="json"><![CDATA[
{
  "list": {"name": "example-tool-catalogue",
           "selection_rule": "weekly editorial pick",
           "entries": 500},
  "window": {"first_snapshot": "2026-09-01",
             "last_snapshot": "2026-10-31",
             "snapshots": 61},
  "platforms": [
    {"platform": "example-code-host", "observed": 400,
     "missing_status": [404, 451]},
    {"platform": "example-model-host", "observed": 100,
     "missing_status": [401, 404]}
  ],
  "consecutive_missing": 2,
  "unavailable": 20,
  "returned": 4,
  "inactive": {"rule": "no push for 90 days", "count": 50},
  "estimator": "kaplan-meier",
  "horizons": [
    {"weeks": 4,  "available": 0.98, "at_risk": 450},
    {"weeks": 8,  "available": 0.96, "at_risk": 300}
  ]
}
]]></sourcecode>
<t>In this example 20 repositories were missing in two snapshots in a row and 4 of them later answered again. The 50 inactive repositories are reported in their own member and are not part of the availability figures.</t>
</section>

  </back>
</rfc>
