Revert "Staging"

Dockerfile

@@ -1,4 +1,4 @@
-FROM ruby:3.3.5
+FROM ruby:3.1.3
 
 RUN apt-get update && \
   apt-get install --reinstall -y locales && \

Gemfile

@@ -21,10 +21,8 @@ end
 gem "tzinfo-data", platforms: [:mingw, :mswin, :x64_mingw, :jruby]
 
 # Performance-booster for watching directories on Windows
-gem "wdm", "~> 0.2.0" if Gem.win_platform?
+gem "wdm", "~> 0.1.0" if Gem.win_platform?
 
 gem "html-proofer", "~> 3.18"
 
-gem 'sass-embedded'
-
 gem 'jekyll-liquify', "0.0.2"

Gemfile.lock

@@ -94,10 +94,9 @@ GEM
     rexml (3.3.9)
     rouge (4.5.1)
     safe_yaml (1.0.5)
-    sass-embedded (1.82.0-x64-mingw-ucrt)
-      google-protobuf (~> 4.28)
-    sass-embedded (1.82.0-x86_64-linux-gnu)
+    sass-embedded (1.82.0)
       google-protobuf (~> 4.28)
+      rake (>= 13)
     sprockets (3.7.5)
       base64
       concurrent-ruby (~> 1.0)
@@ -129,7 +128,6 @@ DEPENDENCIES
   jekyll-seo-tag
   jekyll-sitemap
   kramdown-parser-gfm (~> 1.1.0)
-  sass-embedded
   sprockets (~> 3.7)
   tzinfo-data
   webrick (>= 1.8.2)

_includes/searchgov/form.html

@@ -13,12 +13,12 @@
     <input name="utf8" type="hidden" value="&#x2713;" />
     <input name="affiliate" type="hidden" value="{{include.searchgov.affiliate}}" />
 
-    <!-- <div role="search" hidden>
+    <div role="search">
       <label class="usa-sr-only" for="extended-search-field-small">Search small</label>
       <input class="usa-input usagov-search-autocomplete" id="extended-search-field-small" type="search" name="query" autocomplete="off">
-       <button class="usa-button search-btn" type="submit">
+      <button class="usa-button search-btn" type="submit">
           <img src="{{site.baseurl}}/assets/img/usa-icons-bg/search--white.svg" class="usa-search__submit-icon" alt="Search" />
-      </button> 
-    </div> -->
+      </button>
+    </div>
   </form>
 {% endif %}

_posts/2024-1-17-economy-recovery.md

@@ -0,0 +1,86 @@
+---
+title: Actionable Learning about Economic Recovery
+layout: post
+date: January 23, 2024
+author: Jed Herrmann, U.S. Department of the Treasury
+excerpt: Treasury is using evidence to inform program implementation and is looking for opportunities to collaborate with researchers on evaluations (who can express interest by emailing <a href="mailto:[email protected]">[email protected]</a>)...
+aria: 
+tags: Evaluation Evidence-Use
+filters: evaluation evidence-use
+#permalink: /actionable-learning-about-economic-recovery/
+image: economic-recovery-circle.png
+img-alt: Economic Recovery Learning Agenda cover
+thumbnail: economic-recovery-thumbnail.png
+thumbnail-alt: Economic Recovery Learning Agenda cover
+---
+
+*Summary: Treasury is using evidence to inform program implementation and is looking for opportunities to collaborate with researchers on evaluations (who can express interest by emailing [[email protected]](mailto:[email protected])).*
+
+The U.S. Department of the Treasury recently released an [updated Economic Recovery Learning Agenda](https://home.treasury.gov/system/files/136/ORP-Learning-Agenda-Final.pdf){:target="_blank"}. This learning agenda is designed to guide research by Treasury, other federal partners, external researchers, and state and local governments that received awards from Treasury to understand the impact of the country's economic recovery programs on households, organizations, communities, and governments.
+
+This economic recovery line of inquiry focuses on Treasury's efforts to administer an efficient, effective, and equitable economic recovery for the country in the aftermath of the COVID-19 pandemic. As part of the Biden-Harris Administration's response to the pandemic, Treasury's Office of Capital Access (formerly known as the Office of Recovery Programs) is managing approximately $600 billion in programs aimed at helping state/local governments and communities respond to and recover from the pandemic. Many of these programs are completely new and thus present a great opportunity for research and learning to help with program implementation and consider how to design future programs. They also include large funding streams to support housing, broadband infrastructure, and small businesses.
+
+<h3><i>Learning and Equity</i></h3>
+
+The Economic Recovery Learning Agenda is focused on continuous improvement in the implementation of federal economic programs and stems from Treasury's first ever [enterprise Learning Agenda](https://home.treasury.gov/system/files/266/Treasury-FY2022-2026-LearningAgenda.pdf){:target="_blank"}, which was issued in 2022 and outlines learning priorities across five goals and 19 strategic objectives, including two high-level questions related to economic recovery that serve as the basis for the more in-depth Economic Recovery Learning Agenda. The Economic Recovery Learning Agenda aims to spur evidence building to help us **learn** about the effectiveness and equity of the programs, **highlight** the results we have seen, and **share** lessons learned that can be applied in the future.
+
+<img src="{{site.baseurl}}/assets/images/blog/econ-recovery-img-1.png" alt="Graphic showing that Treasury's learning agenda is designed to learn about effective programs, highlight outcomes, and share lessons learned. " class="margin-left-auto margin-right-auto display-block blog-img-width">
+
+Advancing equity is a [major emphasis](https://www.whitehouse.gov/wp-content/uploads/2022/05/ADVANCING-EQUITY-THROUGH-THE-AMERICAN-RESCUE-PLAN.pdf){:target="_blank"} of the Administration's economic policies with a focus on serving those households and communities that are most in need of assistance. Treasury's evidence activities and the learning agenda are centrally focused on equity as an organizing principle.<a href="#ftn1" class="text-no-underline" aria-label="footnote 1"><sup>1</sup></a> As such, the Economic Recovery Learning Agenda is premised on the idea that equity and outcomes are not mutually exclusive but rather inextricably linked---programs will not reach their true goals unless they are advancing more equitable outcomes.
+
+<img src="{{site.baseurl}}/assets/images/blog/econ-recovery-img-2.png" alt="Graphic showing that equity and outcomes are intertwined with the goal of achieving equitable outcomes. " class="margin-left-auto margin-right-auto display-block blog-img-width">
+
+<h3><i>Engaging Stakeholders to Refine Evaluation Priorities</i></h3>
+
+This updated [Economic Recovery Learning Agenda](https://home.treasury.gov/system/files/136/ORP-Learning-Agenda-Final.pdf){:target="_blank"} incorporates changes based on extensive stakeholder engagement that Treasury conducted to receive feedback on a draft version released in spring 2023. To solicit this feedback, which was intended to make sure research priorities were informed and actionable by people outside of the federal government, we conducted approximately a dozen listening sessions, including both in-person and virtual. These sessions garnered a wide range of feedback from over 100 individuals and organizations, including state, local, and Tribal governments that received award funds, program beneficiaries, researchers, philanthropy, academics, think tanks, community organizations, government associations, members of the public, and other federal agencies.
+
+In response to this feedback, the updated learning agenda contains more details on specific programs' evaluation priorities, more information on the data available to conduct research, broader recognition of key stakeholders, and a greater emphasis on equity.
+
+<img src="{{site.baseurl}}/assets/images/blog/econ-recovery-img-3.png" alt="Chart showing that Treasury used stakeholder feedback to make the learning agenda more focused on equity, include more specific evaluation details, and provide information on available data." class="margin-left-auto margin-right-auto display-block blog-img-width">
+
+For example, the context and stories that we heard from people who have received assistance through these programs helped us to refine the evaluation questions in the learning agenda. As a result, we created a new section for each evaluation question (highlighted below) to capture more specific and actionable areas for research that would provide valuable information toward answering the overarching research questions.
+
+<img src="{{site.baseurl}}/assets/images/blog/econ-recovery-img-4.png" alt="Screenshot from the learning agenda illustrating how Treasury added more evaluation details to the learning agenda in response to stakeholder feedback." class="margin-left-auto margin-right-auto display-block">
+
+We received many detailed responses that helped us refine the specific research questions for the programs administered by Treasury. For the Emergency Rental Assistance<a href="#ftn2" class="text-no-underline" aria-label="footnote 2"><sup>2</sup></a> (ERA) program, for example, we included more opportunities for research about the role of landlords in the rental housing ecosystem. In particular, we included [additional research questions](https://home.treasury.gov/system/files/136/ORP-Learning-Agenda-Final.pdf#page=17){:target="_blank"} on the distribution of rental assistance funds to different types of landlords, including landlords that own a small number of properties and often have similar demographics to the renters they serve.
+
+This learning agenda is designed to be relevant for immediate program implementation as well as the longer-term view. The focus on both short-term implementation and long-term lessons means that we are interested in a variety of study designs, including:
+
+<img src="{{site.baseurl}}/assets/images/blog/econ-recovery-img-5.png" alt="Graphic illustrating that Treasury interested in descriptive evaluations, impact evaluations, process evaluations, and other evaluation tools." class="margin-left-auto margin-right-auto display-block blog-img-width">
+
+In fact, Treasury has already used descriptive and process evaluations to make adjustments to a number of programs. For example, in the context of the <a href="https://home.treasury.gov/policy-issues/coronavirus/assistance-for-state-local-and-tribal-governments/state-and-local-fiscal-recovery-funds" target="_blank" aria-label="State and Local Fiscal Recovery Funds">State and Local Fiscal Recovery Funds</a> program, we used a process [evaluation](https://oes.gsa.gov/projects/slfrf-tribal-govs-neus/){:target="_blank"} to collect and analyze information about barriers facing very small localities and Tribal governments that received these funds, aimed at improving our efforts to help them comply with program requirements.
+
+<h3><i>Collaboration to Build Evidence</i></h3>
+
+A key part of Treasury's approach to evaluation is engagement with external researchers. We have [highlighted a dozen areas](https://home.treasury.gov/system/files/136/ORP-Learning-Agenda-Final.pdf#page=5){:target="_blank"} where we would be particularly interested in this engagement. In this regard, Treasury has posted two evidence portal opportunities for external collaboration here, on Evaluation.gov, for the [Homeowner Assistance Fund]({{site.baseurl}}/assets/resources/Portal - Treasury - HAF w researcher interest.pdf){:target="_blank"} program (question number 2 in the graphic below) and <a href="{{site.baseurl}}/assets/resources/Portal - Treasury - SLFRF w researcher interest.pdf" aria-label="Evidence project portal resource - SLFRF" target="_blank">State and Local Fiscal Recovery Funds</a> program (question number 3 in the graphic below).
+
+<p class="blog-text-box"><i>A sampling of questions from the learning agenda, highlighted in bold, where Treasury is interested in collaborating with researchers.</i></p>
+
+<img src="{{site.baseurl}}/assets/images/blog/econ-recovery-img-6.png" alt="Screenshot from learning agenda listing evaluation questions for HAF and SLFRF. " class="margin-left-auto margin-right-auto display-block blog-img-width">
+
+As an example of collaboration, Treasury has had a robust partnership with the Office of Evaluation Sciences on [over 10 evaluations](https://oes.gsa.gov/american-rescue-plan/){:target="_blank"} with a significant focus on using the results to inform program implementation. In addition, we are [engaged](https://archives.hud.gov/news/2022/pr22-226.cfm){:target="_blank"} with four research organizations to study the impact of the Emergency Rental Assistance program in coordination with the U.S. Department of Housing and Urban Development. As part of this collaboration, Treasury has shared detailed household-level data for these evaluations and is providing assistance to help researchers answer evaluation questions that are [highlighted in our learning agenda](https://home.treasury.gov/system/files/136/ORP-Learning-Agenda-Final.pdf#page=20){:target="_blank"}. 
+
+By collaborating with outside experts, Treasury can learn lessons that will be valuable for future programs. These collaborations could consist of a variety of models, including program briefings and matchmaking between researchers and federal financial assistance recipients. As highlighted in the learning agenda, Treasury is already making an [extensive amount](https://view.officeapps.live.com/op/view.aspx?src=https%3A%2F%2Fhome.treasury.gov%2Fsystem%2Ffiles%2F136%2FQ2-2021-Q2-2023-ERA2-Reporting-Data.xlsx&wdOrigin=BROWSELINK){:target="_blank"} of [data publicly available](https://app.high.powerbigov.us/view?r=eyJrIjoiZWYyMjgyZTMtNDc0NS00NTJiLTk5N2UtYzU3M2UwMDA0Y2VjIiwidCI6IjU4ZjFlM2ZhLTU4Y2ItNGNiNi04OGNjLWM5MWNhYzIwN2YxOCJ9){:target="_blank"} but research collaborations could also potentially include additional data sharing. Researchers interested in collaborating with Treasury should send an email to us at <[email protected]>{:target="_blank"}.
+
+<h3><i>Applying Evidence to Inform Policy</i></h3>
+
+As an example of putting evidence into action, Treasury and the Office of Evaluation Sciences partnered to [evaluate](https://oes.gsa.gov/projects/era-equity/){:target="_blank"} the equity of the Emergency Rental Assistance programs by examining how the demographics of renter households that received ERA assistance compare to the demographics of those renter households that are eligible to receive ERA assistance. Research conducted prior to the COVID-19 pandemic showed that Black renters and women renters represented a disproportionate share of those served with eviction filings. As such, Treasury focused on targeting outreach to these populations and working with ERA grantees to streamline the application process for ERA assistance to ensure that rental assistance reached those tenants most in need.
+
+The evaluation found that Black renters and women renters were overrepresented among households that received rental assistance, across all regions of the U.S., and that funds were much more likely to reach "extremely low income" renters, or those whose households earn less than 30% of the area's median income.
+
+<img src="{{site.baseurl}}/assets/images/blog/econ-recovery-img-7.png" alt="Graphic showing the results of an ERA  study demonstrating the equitable implementation of the program. " class="margin-left-auto margin-right-auto display-block blog-img-width">
+
+In this case, the study illuminated that Treasury's efforts had generally been successful in reaching target populations that were most at risk of eviction. While the evaluation also found underrepresentation of White and Latinx renters, this was only at the higher end of the eligible income spectrum---extremely low-income White and Latinx renters were overrepresented among beneficiaries of ERA assistance, which reinforced the success of the program outreach efforts. However, Asian renters were moderately underrepresented at all income levels, which is consistent with their participation in other government benefit programs. Nonetheless, these findings led us to do subsequent outreach work to identify barriers for Asian tenants and make updates to better reach these populations. 
+
+<h3><i>A Virtuous Cycle</i></h3>
+
+As illustrated above, Treasury is engaged across the full spectrum of evaluation from outlining priorities and conducting evaluations to using findings to inform program implementation. This virtuous cycle of applying evidence to practice is key to Treasury's economic recovery work. Treasury's approach is focused on using evaluation as a learning tool for improving program implementation and the design of future economic recovery programs. 
+
+*Jed Herrmann is a Senior Advisor in the U.S. Department of the Treasury's Office of Capital Access.*
+
+
+...
+
+<sup id="ftn1">1</sup> For the purposes of its work, Treasury defines equity according to [Executive Order 13985, on Advancing Racial Equity and Support for Underserved Communities Through the Federal Government](https://www.whitehouse.gov/briefing-room/presidential-actions/2021/01/20/executive-order-advancing-racial-equity-and-support-for-underserved-communities-through-the-federal-government/){:target="_blank"}.
+
+<sup id="ftn2">2</sup> Two separate ERA programs have been established: the ERA1 program was authorized by the Consolidated Appropriations Act of 2021 and provided $25 billion to assist eligible households with financial assistance and housing stability services.  The ERA2 program was authorized by the American Rescue Plan Act of 2021 and provides $21.55 billion to assist eligible households with financial assistance, provide housing stability services, and as applicable, to cover the costs for other affordable rental housing and eviction prevention activities.

_posts/2024-9-2-challenge-winners.md

@@ -22,7 +22,7 @@ At the inception of this Challenge, OMB recognized the need for a user-friendly
 
 In a recent interview with Challenge.gov, representatives from The Improve Group Cooperative shared what motivated them to enter this Challenge. "We live in a time when there are lots of different information sources and people don't have high trust in government.... The PMA acknowledges the history of people not feeling engaged. When people witness a deeper engagement effort like this Challenge and see what came out as a result, with emphasis on the result and how their feedback affected policy, they eventually become more engaged citizens." When asked about the unique aspects of their toolkit, The Improve Group officials highlighted their focus on how to conduct evaluations while implementing PPCE activities, how to use different methods of evaluation, and how to track trust building over time. In developing this evaluation toolkit, The Improve Group visualized an employee conducting *and* evaluating the engagement without having to overcome a huge learning curve. "Employees conducting engagement projects should feel empowered to do an evaluation themselves and not need to bring a separate 'evaluator' on board. This toolkit aims to provide agency staff with resources to do just that."
 
-The resource is now available, on <a href="https://www.performance.gov/" target="_blank" aria-label="Performance.gov website">Performance.gov</a>, and will be shared widely with Federal agencies. OMB will also coordinate with The Improve Group to ensure that agencies taking up the toolkit have the resources and support they need to benefit from the rich collection of tools and insights it provides. We are very excited to announce the release of the toolkit!
+The resource is now available here on [Evaluation.gov]({{site.baseurl}}/assets/resources/The Improve Group PPCE Toolkit.pdf), on <a href="https://www.performance.gov/" target="_blank" aria-label="Performance.gov website">Performance.gov</a>, and will be shared widely with Federal agencies. OMB will also coordinate with The Improve Group to ensure that agencies taking up the toolkit have the resources and support they need to benefit from the rich collection of tools and insights it provides. We are very excited to announce the release of the toolkit!
 
 * * * * *
 

_resources/2023-09-26-Highlights-from-the-PMALA-Workforce-Symposium.md

@@ -0,0 +1,11 @@
+---
+title: 'PMA Learning Agenda: Highlights from the PMALA Workforce Symposium'
+year: 2023
+description: 
+doc-link: assets/resources/PMA Learning Agenda Workforce Symposium.pdf
+aria-label: PMA Learning Agenda Workforce Symposium
+content_tags:
+type: pdf
+filters: report 2023 evidence-use omb
+post-date: September 27, 2023 # # must add post date to show the "new" icon
+---