"Schools should not begin with the question, 'How do we get more devices into more classrooms?' They should begin with the question, 'What learning problem are we trying to solve, and what evidence suggests this tool will solve it?'"
Executive Summary
Virginia should stop treating educational technology as presumptively beneficial. The evidence does not support a blanket rejection of digital tools. But it does support a strong presumption against indiscriminate device use, especially when screens displace deep reading, handwriting, sustained discussion, and teacher-guided instruction.
Three key claims drive this brief:
- Broad 1:1 device initiatives produce weak academic gains. A major meta-analysis found an overall achievement effect around d = 0.16.
- Some core classroom activities suffer on screens. Meta-analyses find consistent comprehension advantages for paper reading over screen reading.
- The evidence is highly conditional. Structured tools (CAI d = 0.47, ITS d = 0.48) show moderate positive effects.
The Core Claim
Virginia does not need an anti-technology crusade. It needs a higher burden of proof. For too long, educational technology has been treated as a modernization strategy instead of an instructional strategy.
The policy problem in Virginia is not whether some digital tools work. Many do. The problem is that schools have often treated device access itself as the intervention.
When technology is tightly linked to a specific learning function, results look better. The question is not "technology or no technology," but "generic devices or evidence-based tools."
What the Evidence Says About 1:1 Devices
A major meta-analysis found d = 0.16. Hattie's synthesis lands in the same place. A weak intervention, especially once districts account for hardware costs, software subscriptions, management burdens, teacher training time, and the opportunity cost.
Screens, Reading, and Cognitive Friction
Any serious Virginia literacy agenda has to reckon with screen reading research.
Expository reading is the language of civics, science, history, and technical subjects.
This does not mean screens should disappear from literacy instruction. It does mean Virginia should stop assuming that digital reading is a neutral substitute for paper.
Handwriting, Note-Taking, and Memory
A meta-analysis found that electronic notetaking methods reduced measured outcomes with r = -0.142. That effect matters at scale. Handwritten note-taking forces selection, summarization, and encoding.
Attention Is Not a Side Issue
The strongest argument against indiscriminate classroom technology use is attention.
- Nearly 1 in 3 students said classmates are distracted by devices in most or every math lesson
- 59% said attention was diverted by others using devices in at least some lessons
- Students distracted by peers' devices scored approximately 15 points lower in mathematics
The finding that should change the conversation
Students who multitasked on laptops performed worse. But nearby students were also harmed by being seated within view of those screens. Distraction isn't just personal. It's environmental. (Sana et al., 2013)
What Pro-EdTech Research Gets Right
Technology can help when it delivers immediate feedback, supports guided practice, provides adaptive tutoring, expands accessibility, gives students access to materials they otherwise wouldn't have.
The real pro-edtech argument
The strong pro-edtech argument is real, but narrow: technology can be worthwhile when it is targeted, constrained, and tied to a clear mechanism of learning. The weak argument — "students need devices because the future is digital" — is too vague to justify the practice.
Virginia's Policy Contradiction
In July 2024, Governor Youngkin issued Executive Order 33, directing "cell phone-free education."
Virginia Has Created a Policy Contradiction
On one hand, the state recognizes that unmanaged devices can impair focus. On the other, it still largely funds school technology as if access itself were presumptively beneficial.
Virginia's 2024 grade 4 reading proficiency was 73% on the state system versus 31% on NAEP.
International Precedents
Sweden reversed its early-digitization push after national assessment declines, shifting back toward printed textbooks and teacher-led instruction.
Netherlands: 75% of high schools saw better concentration after phone restrictions.
England: Phone bans were associated with gains equivalent to 14% of a standard deviation for lower-achieving students.
Global (UNESCO): 114 education systems have implemented some form of phone ban, reflecting growing international consensus that unmanaged devices impair learning environments.
What Virginia Should Prioritize Instead
| Intervention | Effect Size |
|---|---|
| Direct instruction | d = 0.60 |
| Teacher-student relationships | d = 0.53 – 0.72 |
| Intelligent tutoring systems | d = 0.48 |
| Computer-assisted instruction | d = 0.47 |
| High-dosage tutoring | d = 0.37 |
| 1:1 laptops (general) | d = 0.16 |
The Purpose-First Framework
Every major technology adoption should answer five questions:
- Learning Goal: What exact learning problem is this tool solving?
- Evidence Base: What evidence shows this type of tool works in similar settings?
- Displacement Cost: What high-value classroom activities will it replace?
- Attention Safeguards: What safeguards will protect student attention?
- Measurement and Exit Ramps: What outcomes will we measure, and what happens if they don't improve?
Policy Recommendations
- Require VDOE to report edtech spending alongside outcomes
- Condition technology grants on evidence-based implementation plans
- Fund an independent evaluation of Virginia's edtech ROI
- Adopt purpose-first technology policies
- Request data on device usage patterns and achievement correlation
- Question default assumptions about device-driven improvement
- Audit current edtech contracts and utilization
- Protect instructional time from technology-related distraction
- Prioritize professional development on high-impact instruction over device training
- Advocate for paper-based options when research supports them
- Document instructional time lost to device management
- Share what works with leadership
- Ask how technology is being used in your child's classroom
- Request information on edtech spending
- Support phone-free and device-limited learning environments
Conclusion
Virginia should stop treating educational technology as presumptively beneficial. The evidence supports a strong presumption against indiscriminate device use. A school system serious about literacy, attention, and honest standards should not ask whether a device is available. It should ask whether the device has earned its place.
Sources
- Delgado, P., et al. (2018). Don't throw away your printed books. Educational Research Review, 25, 23–38.
- Hattie, J. (2023). Visible Learning MetaX. Corwin.
- Nickow, A., Oreopoulos, P., & Quan, V. (2020). The Impressive Effects of Tutoring. NBER Working Paper 27476.
- OECD. (2023). PISA 2022 Results (Volume I).
- OECD. (2024). Managing screen time.
- Sana, F., Weston, T., & Cepeda, N.J. (2013). Laptop multitasking hinders classroom learning. Computers & Education, 62, 24–31.
- Stockard, J., et al. (2018). The effectiveness of direct instruction curricula. Review of Educational Research, 88(4), 479–507.
- UNESCO. (2023). Global Education Monitoring Report: Technology in Education.
- Virginia Department of Education. (2024). Draft Guidance for Cell Phone-Free Education.
- Zheng, B., et al. (2016). Learning in one-to-one laptop environments. Review of Educational Research, 86(4), 1052–1084.