neurodiversity

How Life Outside of School Shapes Childhood Education

Part 2 in a series. In my study of what works in the effort to serve children’s needs and help them to become happy and healthy adults, I take copious notes. I find it helpful, occasionally, to compile and summarize these notes into a narrative. Why? Because my brain saves all of these notes, and my conversations are built from them, but sometimes the conversations don’t last long enough to articulate the internal narrative I’m working from. This series is an attempt to share my internal narrative, and open it to peer review. I take my notes from memory, and almost never cite sources. That being said, I invite the reader to connect any of the points made here to existing research and share their conclusions. This is a conversation, not a dissertation.

The history of American education is usually told through its institutions—the schoolhouse, the curriculum, the policy. But for most of the past two and a half centuries, the school day occupied only a fraction of a child’s waking hours. What happened in the remaining hours was not a blank space, and not the same for every child. It also counts as education—in labor, in play, in hunger or comfort, in the rhythms of a household shaped by class, race, and economic circumstance. The school day has always had a shadow: longer, less legible, and distributed with the same radical inequality as everything else. What follows is an attempt to describe that shadow in the same fifty-year intervals as the institutional history it runs alongside.

This is not original scholarship: it’s simply an overview in a legible timeline to point out patterns that have been documented in depth elsewhere. It’s a way of opening my working premises to a wider conversation. Let it be a springboard to deeper inquiry, rather than a document of record.

1750–1800: Childhood as Labor

For the vast majority of children in colonial America, the question of what happened outside school was easily answered: work. The agricultural economy ran on the labor of everyone in a household old enough to be useful. Children were useful early. By six or seven, they were tending animals, hauling water, carding wool, minding younger siblings, and helping with whatever the season demanded. The school day, where it existed at all, was short—often only a few hours in the morning—and seasonal, structured around planting and harvest rather than a fixed calendar. A child might attend for a few months in winter when farm labor slackened and be pulled back to the fields before spring.

The school day for a boy of the gentry class looked entirely different. It was longer, held in a dedicated space, and governed by a curriculum that assumed leisure time for further study. Tutors supplemented formal schooling. Books were available at home. The afternoon hours that a farming child spent at labor, a wealthy child might spend in supervised reading, music practice, or what passed for recreational activity—riding, games of skill, the cultivated pastimes of a class that had purchased the right to prepare its sons for a station rather than deploy them as laborers.

For enslaved children, education in anything other than farm labor was forbidden. Their hours belonged entirely to the labor economy of the plantation. Play existed—ethnographic and autobiographical accounts document the games children made in stolen moments—but it was unauthorized, shadowed by the constant proximity of surveillance and violence. Indigenous children in mission settlements were similarly subject to regimented labor under the guise of civilizational education.

The journey to school, where school existed, was almost always on foot. Distance was a real barrier: rural families might live miles from the nearest schoolhouse, and in winter those miles were genuine obstacles. The children most likely to attend were those who lived nearest—which in most communities meant children of the more established families, since the poor tended to live at the margins.

The baseline: Childhood is labor for the majority. The school day is short and seasonal, fitted around agricultural need. Time outside school means more work, not less — except for the children of families wealthy enough to have purchased their children’s time.

Who benefited: Children of the gentry and merchant classes, whose non-school hours were structured around cultivation and leisure. Their childhoods had room in them.

Who was excluded: Farm children, working poor children, enslaved children, and Indigenous children under mission control, for whom the hours outside school were simply more hours of work, or were not theirs to direct at all.

1800–1850: The Mill Child and the Country Child

The early industrial period splits the picture further. In the expanding cities and mill towns of the Northeast, children as young as seven or eight entered factory work—the textile mills of Lowell and Lawrence, the print shops, the glass factories. The school day competed directly with the work day. Many families could not afford to send children to school at all; a child’s wages were a structural part of household budgets. Where children did attend school, they arrived already tired, often having worked early morning shifts before the schoolhouse opened, and left to work again in the afternoon.

The common school movement of this era, championed by Horace Mann and others, was partly a response to this reality—an argument that children needed time set aside for learning. But the reformers were also motivated by anxieties about what unsupervised working-class children did with unstructured time: they played in streets, joined gangs, and generally failed to develop the habits of industry and deference that a properly ordered republic required. The common school was partly a moral intervention into children’s time—a way of filling hours that might otherwise be filled unproductively.

For rural children across the country, childhood outside school still meant the farm. The school day remained short—typically four to six hours—and the school year, even where compulsory attendance laws were beginning to appear, was rarely more than a few months. Play was largely unstructured and took place outdoors: sledding, swimming, fishing, musical ring plays, games of chase and capture that children organized themselves without adult direction. This was not ‘organized unstructured time’ as we think of it today; it was simply that adults were busy and children were left to occupy themselves within the bounds of the property.

For children of wealthy families, the period outside school was increasingly formalized. Music lessons, dancing lessons, and supervised social occasions were the architecture of upper-class childhood. Summer was spent at a second property or a resort. The journey to school might involve a private carriage. Physical distance from school was not an obstacle; it was a marker of social status.

The baseline: The school day is lengthening slightly in urban areas but remains short and seasonally compressed. For working-class and mill children, hours outside school are working hours. For rural children, unstructured outdoor play is the norm. For the wealthy, non-school time is a curriculum of its own.

Who benefited: Children of comfortable rural and merchant families, who had access to unstructured play time, modest material comfort, and a household economy that didn’t depend on their labor.

Who was excluded: Mill and factory children, whose time outside the schoolhouse was largely absorbed by wage labor. Enslaved children. Indigenous children. The urban poor, whose street play was viewed with suspicion and increasingly subject to institutional intervention.

1850–1900: Streets, Fields, and the Factory Floor

By the second half of the nineteenth century, child labor is at its historical peak. The 1900 census—counting at the end of this period—found nearly two million children between ten and fifteen engaged in paid labor, a figure that undercounts younger workers and those in agriculture. In cities, children sold newspapers, shined shoes, worked in canneries and textile mills and coal mines. The school day, now more standardized at roughly six hours in urban public schools, sat in the middle of a much longer day that began before dawn and ended after dark for many working children.

Recess as a formal institution begins to appear in this period, but unevenly. Urban public schools in wealthier districts might have a paved yard and a structured break. Schools in poor neighborhoods had whatever outdoor space happened to be available, if any.

The physical journey to school was almost always on foot, often considerable distances. In rural areas, children might walk two to four miles each way. In cities, the walk passed through neighborhoods where the density of poverty was itself a lesson—in precarity, in the reality of disease, in the density of adult labor.

For the children of the wealthy, this period introduces something new: organized sport and supervised leisure as a class institution. The private school sporting culture—crew, baseball, track—begins to take shape at the prep school level, and trickles into the recreation of upper-class children generally. Summer camps begin to appear in the 1880s, initially as health retreats for urban children of means. The concept of a childhood structured around physical development and wholesome outdoor recreation is being invented—but invented specifically for and by the affluent.

The baseline: Child labor is at its peak. For millions of children, the school day is bracketed on both sides by paid work. Recess exists in wealthier schools; outdoor play is an improvised affair for the poor. The wealthy are inventing organized recreational childhood.

Who benefited: Children of the professional and owning classes, whose non-school hours are increasingly structured around health, sport, and social formation. Their childhood is being designed.

Who was excluded: Working children in mines, mills, canneries, and streets, for whom the hours outside school were the hours that fulfilled the family budget. Rural children who walked hours daily to attend school for a fraction of the year.

1900–1950: The Playground Movement and the Leisure Gap

The progressive era produces the first serious institutional attention to children’s time outside the classroom. The playground movement—led by reformers like Jane Addams and Joseph Lee—argues that unstructured street play is dangerous and that structured outdoor recreation is a democratic necessity. Cities begin building public playgrounds in working-class and immigrant neighborhoods, partly out of genuine concern for child welfare and partly as a form of social control: get children off the streets and into supervised spaces where their energies can be directed appropriately.

Compulsory attendance laws, now on the books in most states, extend the school day and the school year. By the 1920s, a six-to-seven hour school day with a fixed academic calendar is becoming the norm in urban schools. The school day is getting longer; the hours outside it are shrinking, at least in theory. In practice, poor and working-class children remained heavily engaged in household labor—caring for younger siblings, helping with domestic work, working in family businesses—while attending school in the time that remained.

The radio arrives in the 1920s and the after-school hours begin to take a new shape for middle-class families: a domestic, supervised, commercial leisure. Children’s programming fills the late afternoon. Consumption begins to organize childhood time in ways it never had before. This is largely a middle-class phenomenon; the poor listen where they can, but the new consumer childhood—snacks, toys, entertainment—belongs primarily to those with money to spend on it.

For Black children in the segregated South, the school year was often dramatically shorter than for white children—sometimes only three or four months—and the hours outside it were dominated by agricultural labor on a seasonal schedule that white landowners controlled. The gap between the childhood available to a white child in a northern suburb and a Black child in the rural South created a gap in what childhood itself meant to integration into society.

The baseline: The school day standardizes at six to seven hours. Playgrounds appear as institutional interventions into children’s time. Consumer leisure begins organizing middle-class childhood. For poor and Black children, time outside school remains dominated by labor, with wide regional disparities.

Who benefited: Middle-class white children in northern cities, who gain access to supervised playgrounds, consumer entertainment, and a lengthening period of structured childhood. Their afternoons are beginning to look like what we think of as childhood.

Who was excluded: Black children in the rural South, subject to truncated school years and heavy agricultural labor; immigrant and working-class children whose household economies still depended on their labor; children in overcrowded urban tenements with no access to outdoor play space.

1950–2000: The Suburban Afternoon and the Forgotten Child

The postwar period produces what many Americans still imagine when they picture a normal childhood: the suburban afternoon. School ends at three o’clock. Children walk or are driven home. The neighborhood is safe enough for unsupervised play; someone’s mother is usually around. Dinner at six. Television in the evening. This is the dominant image of mid-century American childhood—and it is the childhood of white suburban families, made possible by the GI Bill, federally subsidized highways, and housing policies that systematically excluded Black families from the neighborhoods where that afternoon was happening.

In cities, the picture is different. Urban public schools often lack the outdoor space of suburban ones. After-school hours in dense neighborhoods are spent on stoops, in streets, in apartments where multiple families share small units. For children of working mothers—a category growing rapidly through this period—the after-school hours can mean latchkey solitude, or the informal supervision of older siblings, or the streets.

The length of the school day remains roughly stable—six to seven hours—but what surrounds it begins to diverge sharply by class. Affluent families begin investing in after-school enrichment: music lessons, sports leagues, tutoring, summer programs. The infrastructure of organized childhood expands enormously in the 1970s and 1980s for families with money. Youth soccer leagues, swim teams, private music instruction, SAT prep courses—the non-school hours of wealthy children become as intentionally structured as the school hours, sometimes more so.

For poor children, the after-school hours are increasingly unsupervised and under-resourced. Public recreation programs are cut during the fiscal crises of the 1970s. Community centers close. The street remains, but the organized infrastructure of working-class neighborhood life—the settlement house, the church league, the union-sponsored recreation program—is fraying. The gap between what a wealthy child does from 3–6pm and what a poor child does in those same hours begins to compound into measurable outcome differences by high school.

Children arrive at school by bus, by car, and on foot—but increasingly, in wealthy districts, by car in the exclusive sense. The school run as a daily parental ritual is a product of this period. In poorer districts, the school bus (or public transit, or walking) remains the norm. The physical experience of getting to school—comfortable, supervised, door-to-door versus exposed, crowded, long—is itself a daily index of the broader divergence.

The baseline: The suburban afternoon becomes the idealized image of American childhood—and the reality for white middle-class families. Enrichment infrastructure expands dramatically for the affluent. Public recreation resources contract for the poor. The after-school hours become a second site of compounding inequality.

Who benefited: White suburban children, whose afternoons are safe, supervised, and increasingly enriched by organized extracurricular activity. Their non-school hours are an extension of their educational advantage.

Who was excluded: Urban and rural poor children, whose after-school hours are unsupervised and under-resourced; Black families systematically excluded from the suburban neighborhoods where the postwar childhood was being built; working-class children whose mothers’ labor left them alone after three o’clock.

With Change Comes Resistance: The Leisure Gap Widens (1970s–1990s and beyond)

As the institutional history of education produces its backlash—against busing, against equity funding, against the framing of school as a site of redistribution—the same dynamic plays out in the texture of children’s daily lives. When public recreation programs are cut, they are cut in the name of fiscal responsibility. When after-school programs lose funding, the loss is framed as an unfortunate necessity. The cumulative effect is that the public infrastructure of childhood—the commons of play, the shared recreational space, the after-school program that any child could attend—quietly contracts, and the private infrastructure of childhood expands to fill the gap, accessible only to those who can pay for it.

This is not accidental. The same political grammar that converts equity funding in schools into an unfair advantage converts public investment in children’s time into government overreach. The playground, the public pool, the after-school program—these are all, in the backlash framing, things that responsible families provide for themselves. Public provision is for families who failed to provide. The logic individualizes what is structurally produced, and then blames the individual for the structural outcome.

By the 1990s, the research literature on out-of-school time is documenting what is already obvious to anyone paying attention: children in poverty spend their after-school hours very differently from children with resources, and those differences compound across years into significant gaps in academic preparation, social-emotional development, and college readiness. The response is a wave of after-school program funding—21st Century Community Learning Centers, extended day initiatives—that partially addresses the gap while leaving the underlying inequality untouched.

2000–Present: Scheduled Childhood and the Unsupervised Hours

The contemporary period produces two childhoods in increasingly sharp relief. The first is the fully scheduled childhood of affluent families: school, then sports practice, then music lesson, then homework, then sleep—every hour accounted for, every activity selected for its developmental and resumé value. This childhood is exhausting and productive and deeply anxious. It is also, on the other hand, very good preparation for competitive college admission and the professional-managerial economy that follows.

The second childhood has no such schedule. It is the childhood of children whose families lack the money, time, or stability to organize their non-school hours. It is spent on phones, in front of screens, in apartments, or in neighborhoods where the outdoor infrastructure of play has been allowed to deteriorate. It is not necessarily an unhappy childhood—children are resourceful—but it is not building toward the same outcomes. The difference between these two childhoods, played out across millions of families, is one of the primary mechanisms by which inequality reproduces itself across generations while appearing to result from individual choices.

The school day has lengthened in many districts—particularly those serving high-poverty populations, where extended day programs have been implemented as an equity intervention. The journey to school has shifted: in urban areas, a growing number of children are driven rather than walking, reversing the pedestrian norm of earlier eras and further sorting children by the access their families have to a car and flexible time. Remote learning during COVID collapsed the boundary between school time and home time entirely—with consequences that followed the same distributional lines as everything else. Children with quiet space, adult supervision, and reliable broadband managed. Children without those things largely did not.

Play, as an unstructured and self-directed activity, is declining across class lines—but most sharply for the children who have historically relied on it most. Recess is being cut in schools under academic pressure. Outdoor play in neighborhoods is declining due to parental safety concerns that are partly real and partly a function of media-amplified fear. The physical and developmental consequences of this decline are well-documented and not evenly distributed.

The baseline: Two divergent childhoods separated by money. The affluent child’s non-school hours are maximally structured and developmentally intentional. The poor child’s hours are under-resourced and unsupervised. The school day is lengthening in high-poverty districts as a compensatory measure. Unstructured play is declining everywhere.

Who benefited: Children of wealthy families, whose after-school hours function as a second, private educational system. Their non-school time compounds their advantage.

Who was excluded: Children in poverty, whose unstructured hours are the most visible symptom of everything the public system declined to provide. Children in under-resourced neighborhoods where the infrastructure of play—the park, the pool, the after-school program—has been allowed to deteriorate.

The Through-Line

The history of what children do outside school is not separate from the history of school. It is the same history, told from the other side of the door. In every era, children who benefited most inside the school building also had the most outside it: more time, more space, more safety, more supervision, more materials, more adult attention, more room to be children rather than workers or caretakers or simply left alone. The children who benefited least inside the building had the least outside it. The gap between the two was not a gap in effort or aptitude—it was a gap in what the society was willing to organize and provide.

What the school can do is always bounded by what it cannot reach. The child who arrives hungry, exhausted from an unsafe commute, responsible for younger siblings, carrying the anxiety of household instability—that child is not starting from the same place as the child who arrives rested, fed, driven by a parent, and free from adult responsibility for the next seven hours. The school day measures from bell to bell. The field of education begins much earlier, and runs much later, and is shaped by forces the school rarely controls and almost never names.

A genuine alternative to this history would have to account for what happens outside the building—not as a supplementary concern, but as a structural one. The hours between 3—6pm are not separate from the school day. They are its extension.