Golden Ghetto, History and Historians, Now in Actual Work, Our Glorious National Heritage

The Past is Flat, But the World is Round

Or, Gibson, Friedman, and #FirstWorldProblems

How evenly distributed was the future, in the past?

Yesterday, Alexis Madrigal distilled novelist Teju Cole’s tweeted critique1 of what’s wrong with #firstworldproblems – as a concept – and it got me thinking.

His post goes into a bit more detail (and explains what #firstworldproblems signifies), but here are the key lines of Cole’s analysis:

I don’t like this expression “First World problems.” It is false and it is condescending. Yes, Nigerians struggle with floods or infant mortality. But these same Nigerians also deal with mundane and seemingly luxurious hassles. …

… people don’t wake up with “poor African” pasted on their foreheads. They live as citizens of the modern world. … the interesting thing about modern technology is how socially mobile it is–quite literally. Everyone in Lagos has a phone.

Quite so. The approach that twitterers using #firstworldproblems take to the developing world mirrors, in no small part, the approach Europeans (and later, Americans) took to the “new” worlds of the Americas, Africa, and Asia. To assume that no one in Lagos is frustrated with her iPad’s inability to sync properly is to assume that Lagos exists in a different stage of history, a different time – pace Gibson, “[t]he future is already here — it’s just not very evenly distributed.” But listening to Cole, it seems the future is actually very well distributed – at least geographically; in our brave new world, wealth forms more of a barrier than oceans.2

The key difference in both usages is history, represented by technological gadgetry (and sometimes infrastructural abundance). Time passed, in this view, is progress achieved — a view echoed, from another vantage point, in a related meme-driven complaint about the lack of flying cars. In this, as in so many ways, our way of seeing the world is an iron Enlightened Victorian imperialist cage, albeit one with some of the sharp edges sanded off.

Continue reading “The Past is Flat, But the World is Round”

History and Historians, Our Glorious National Heritage, Power At Play

Everything Old Is New, Again

Or, A Little Presentism Goes a Long Way

Historians like to think that even as we study the past, we’re doing something new. Bringing fresh light to unexplored recesses, listening, patiently, to quiet, pained voices – or, more aggressively, stripping away the accumulated decades-deep varnish of myths and flipping the table on complacent “just-so” stories about how we got into our present mess. And so on.

I’m no different. Part of the sales pitch for my own work (Hellloooo future employers and funders!) is that early American trade with Asia is understudied – and so, by examining at its sources we can not only learn more about the trade itself, but also overturn long-standing debates in “wider” fields (e.g. American early republic or antebellum history). This is should be a familiar tune to all of you, I’ve sung it enough…

But history, in its modern incarnation, is not a new field; these habits are old. Even (or perhaps especially) when it comes to studying early American trade with Asia.

Allow me to illustrate. In 1937, in his monumental study of the Jackson and Lee merchant families Ken Porter complains, at length, that the American China trade is too well known , romanticized, even – and that the trend in the extant literature is to obscure an equally important topic: U.S. trade with British India.*

It was the trade with the Far East which gave early American commerce its characteristic flavor, but although the early history of the China trade has been told and retold, the story of the trade with Calcutta and other ports in India remains un-recounted either in scholarly or popular form. [emphasis mine]

The very simplicity of the Canton trade, emphasized by the exotic and fantastic characteristics of its physical background, has made it a favorite theme for writers on American foreign trade. Far otherwise was the situation at Calcutta, a British port, where the lack of any such rigid monopoly as the co-hong or any exclusive policy toward foreigners, coupled with the undeveloped character of native industry, rendered the trade situation almost infinitely more complex. This complexity, which calls for a thorough analysis, has instead produced the effect of repelling investigators, who found in the background of Calcutta trade no such compensatory romantic elements as were furnished by the forbidden world of China. Anecdotes of Houqua, the great hong merchant, abound; but who has more than the name of his millionaire Caclutta contemporary, Ram Duloll Day? [Ramdulal Dey]
~Porter, Jacksons and the Lees, I:28, 52

And, for what it’s worth, Porter was right: at the time he was writing, the U.S. public and scholarly community had been inundated, for at least thirty years, with wistful remembrances, detailed annals, and historical examinations of the American China trade.** That itself was a retread: the China trade, and it’s romantic clippers and secret hongs and smuggling, was celebrated well in to the Gilded Age in travelogues, stories, poetry, and images. Indeed, Porter’s own work was part of a new resurgence of interest in the early history of US-Asia relations, prompted, in all likelihood, by near-term threats to American interests in the Pacific (<cough>WWII</cough>).

Alas, all this kvetching was for naught; not until our own fallen times has U.S. trade with India (as well as China) come under proper consideration (though much good work is being done now).

Porter himself appears to have lost interest – some uphill battles are not worth fighting, I guess? – and devoted the rest of his (extremely long) career to working on the African American experience on the U.S. frontier.

Even among professionals, our historical memory is only the length of a lifetime, if that – and so trends cycle, if not predictably so. This is true, I suspect, in all sub-fields, but certainly in early American history, where once again innovative work is being done by adopting perspectives that echo (at least superficially) those of earlier generations, though hopefully with the benefits that the treadmill of time has provided us.***

But part of that innovation is also a calculated forgetting. Speaking for myself, it would be impossible to write anything new, if I felt obligated to fully represent every quantum of prior work equally in my own scholarship — the accumulated weight of the dust alone would crush me.

Turns out that the the dead hand of the (professional study of the) past is just as easily shrugged off as the past itself; even necessarily so, I think. History, no less than the earth, belongs in usufruct to the living  – though perhaps we would do well to be better stewards of it than we’ve been with the land.****


*Kenneth Wiggins Porter, The Jacksons and the Lees: Two Generations of Massachusetts Merchants, 1765-1844, 2 vols., 3rd ed., Harvard studies in business history 3 (Cambridge, Mass: Harvard University Press, 1969; orig 1937).

**To give but a brief taste of the recent (c. 30 years) lit that Porter might have been frustrated with:

John Watson Foster, American Diplomacy in the Orient (Boston: Houghton, Mifflin and Company, 1903); Frank Erastus Hinckley, American Consular Jurisdiction in the Orient (Washington, D.C: W.H. Loudermilk, 1906); Hosea Ballou Morse, The International Relations of the Chinese Empire, 3 vols. (London: Longmans, Green, and Co, 1910); Charles O. Paullin, “Early Voyages of American Naval Vessels to the Orient,” Proceedings 36, no. 2, United States Naval Institute (USNI) (June 1910): 428-463; Robert Ephraim Peabody, Merchant Venturers of Old Salem; a History of the Commercial Voyages of a New England Family to the Indies and Elsewhere in the XVIII Century, (Boston and New York, Houghton Mifflin Co., 1912); Robert Glass Cleland, “Asiatic Trade and the American Occupation of the Pacific Coast,” Annual Report of the American Historical Association for the Year 1914 I (1916): 283-289; Thomas Franklin Waters, Augustine Heard and His Friends, Ipswich Historical Society publications no. 21 (Salem, Mass.: The Society, 1916); Frederic William Howay, “The Fur Trade in Northwestern Development,” ed. H. M Stevens and Herbert E Bolton, The Pacific Ocean in History (New York, 1917), 276-86; Kenneth Scott Latourette, The History of Early Relations Between the United States and China, 1784-1844, Transactions of the Connecticut Academy of Arts and Sciences 22 (New Haven, Conn: Yale University Press, 1917), http://catalog.hathitrust.org/Record/000521723; State Street Trust Company, Other Merchants and Sea Captains of Old Boston; Being More Information About the Merchants and Sea Captains of Old Boston Who Played Such an Important Part in Building up the Commerce of New England, Together with Some Quaint and Curious Stories of the Sea (Boston, Mass: Walton Advertising and Printing Company: Printed for the State Street Trust Company, 1919); James Christy Bell, Jr., Opening a Highway to the Pacific, 1838-1846 (New York: Columbia University, 1921), http://books.google.com/books?id=uPRYAAAAMAAJ; Tyler Dennett, Americans in Eastern Asia: a critical study of the policy of the United States with reference to China, Japan, and Korea in the 19th Century (New York: The Macmillan Company, 1922); Samuel Eliot Morison, The Maritime History of Massachusetts, 1783-1860, 1st ed. (Boston and New York: Houghton Mifflin Company, 1922); Shü-lun Pan, “The trade of the United States with China” (Ph.D. diss., New York: Columbia University, 1924); Charles H Barnard et al., The Sea, the Ship and the Sailor; Tales of Adventure from Log Books and Original Narratives (Salem, Mass: Marine Research Society, 1925); Sydney Greenbie and Marjorie Latta Barstow Greenbie, Gold of Ophir; or, The Lure That Made America (Garden City, N.Y: Doubleday, Page & Company, 1925); George Granville Putnam, Salem Vessels and Their Voyages, III (Salem, MA: The Essex Institute, 1925); Robert Ephraim Peabody, The Log of the Grand Turks (Boston ;New York: Houghton Mifflin Co., 1926); Charles Frederick Remer, The Foreign Trade of China (Shanghai, China: The Commercial Press, Limited, 1926); Kenneth Scott Latourette, “Voyages of American Ships to China, 1784-1844,” Transactions of the Connecticut Academy of Arts and Sciences 28 (1927), http://catalog.hathitrust.org/Record/000521723; Samuel Eliot Morison, “The India Ventures of Fisher Ames, 1794-1804,” Proceedings of the American Philosophical Society 37 (April 1927): 14-23; George H Danton, The Culture Contacts of the United States and China; the Earliest Sino-American Culture Contacts, 1784-1844 (New York: Columbia University Press, 1931); “Perkins and Company, Canton 1803-1827,” Bulletin of the Business Historical Society 6, no. 2 (March 1, 1932): 1-5; Basil Lubbock, The Opium Clippers (Boston: Charles E. Lauriat company, 1933); E. H. Pritchard, “The Struggle for Control of the China Trade during the Eighteenth Century,” The Pacific Historical Review 3, no. 3 (September 1934): 280-295; Eliot Grinnell Mears, Maritime Trade of Western United States,, Stanford business series (Stanford, Calif: Stanford University Press, 1935); Chen Ching-Jen, “Opium and Anglo-Chinese Relations,” The Chinese Social and Political Science Review 19 (October 1935): 386-437; Amy Christine Carlson, “References to China in American Juvenile Periodicals During the Days of the Old China Trade, 1784-1844.”, 1936

And so on.

***I was having a conversation with a colleague just today about how it’s time to take the doughfaces seriously again! This is an ancient heresy of the worst kind, I tell you.

**** Said with all due obeisances to the lord master of Monticello, of course.

History and Historians, Now in Actual Work, Our Glorious National Heritage, The Past is a Foreign...Something

The Limits of Sympathy for Teas

Or, How Debt Ceilings, Tea, and the tradition of Governing in the U.S. Tangentially Relate

The political crisis du jour is over whether or not Congress will vote to raise the “debt ceiling,” aka the legal borrowing limit for the Federal Government. The broad consensus is that should the debt ceiling not be raised (as is customary), the Federal government would, for the first time ever, fail to pay – and perhaps even repudiate – its debts.

Now, the consequences of such an action are disputed; those seeking to hold firm on the debt ceiling (the Republicans) maintain that there would be no ill effects, just a healthful readjustment of budgetary priorities, while their opponents – and here that includes the Democratic party and associated partisans and officials, bankers, other Wall Street honchos, and most of the media – maintain that failing to raise the debt limit would be tantamount to a financial apocalypse, for the U.S., and possibly the entire world.

So there’s a bit of a gap in the conversation.

I bring it up here not to comment on the issue in particular – though there are some really interesting discussions happening, including some historical debates related to whether or not the 14th Amendment was designed to prevent just a crisis1 – but because lately I’ve been working through documents from the first few years after the Constitution, a period where Congress was determined to do exactly the opposite of what the Republicans are proposing today. Back in the 1790s, the overriding concern for the rulers of the newly re-organized American republic was to figure out how generate revenue so as to pay the U.S.’s debts.

The rub was that Congress had to find a way to do so consistent with the principles of the Revolution – and since there was no real agreement about what these were, or what that would look like, conflict ensued (some things never change). The parts of these machinations that typically get the most airplay are the debates over the “how, who, and what to pay” issues – the internal structuring of the national debt, the creation of a national bank, division of fiscal powers among the different branches, etc. These are the core issues around which the first partisan divide in the nation’s modern history formed, between “Federalists” (the Hamiltonian/Washingtonian conglomeration in favor of an active national government modeled in its fiscal policies after European powers) and the “Jeffersonians” (TJ and Madison’s more structured opposition party that favored a decentralized republic with weaker coercive power).

The attention this dynamic gets is justified – the people involved in these struggles certainly emphasized the “how, who, and what to pay” issues. But they weren’t the only problems being worked out. I’ve been looking how those early Congresses worked out the other part of the debt equation – the “where do we get revenue from” problem.

Here the partisan divide dissolves a bit, because the answer that the Founders gave to the revenue question basically boils down to one phrase: the tariff. The national government did implement other taxes in the early years – there was a pretty heavy tax on personal carriages2, and of course the excise tax on whiskey is well known – but until the introduction of the permanent income tax in the early 20th century, taxes on imported goods and international shipping were the primary revenue for the Federal Government. And, as you might expect of such an important component of government, during that period between Revolution and the 16th Amendment the tariff was among the most powerful drivers of American politics.

~

Long-time readers of this blog will be unsurprised to find out that Asian trade was a non-trivial part of the tariff, in both the debates setting it up and the legislation itself. And in fact, there is a lot that’s unique about the way the Federal Government handled Americans’ involvement in Asian trade which suggests that policymakers regarded it as particularly important.3 But what interests me in connection with the debt ceiling controversy is not the protections the China trade received, but rather how the Federal Government resolved problems with the collection of tariffs on the trade, and what that says about the ultimate priorities of the Founding generation of legislators.

Despite what a visit to your local art museum might lead you to believe, the West’s trade with China in the late 18th-century was not about porcelain, silks, or lacquered furniture, but rather was almost entirely concerned with exchanging silver for tea. The American trade with China was no different; indeed “china ware” was carried back from Canton to U.S. markets chiefly as ballast. The Founding generation, having concluded that taxing widely-consumed beverages with mild psychoactive effects was the most effective, lucrative and appropriate way of gaining a steady income, made duties on tea one of the linchpins of the American revenue system.4 In the tariff acts from 1789 onward, and in the periodic special taxes for defending the frontier and paying down the debt, tea invariably appears as one of the key enumerated items singled out for special attention – and taxation.5

In the early years, though, both the success of the American trade in teas, and the amount of tax it could reasonably bear, were unknowns. It is unsurprising, then, that the government ran into trouble with collections. The problem was not that tea taxes were somehow verboten because of their role in sparking the Revolutionary struggle.6 The difficulty was more prosaic: an oversupplied market meant that merchants couldn’t pay their taxes without going broke.

It was a classic boom-bust case. Americans’ rush into the China trade in the late 1780s and early 1790s flooded the U.S. market with cargoes of tea – enough in 1790 alone for three years’ of domestic consumption, according to one (admittedly self-interested) China merchant.7 With supply and demand being in an inverse relationship and all, this in turn led to both a precipitous drop in the commodity’s price and a marked rise in petitions to Congress. As merchants found themselves with stocks of teas that could not be sold even at cost, they presented Congress with a dilemma: how to best secure an important source of revenue while at the same time encouraging growth in a key economic sector?8

The merchants themselves were divided. Some requested stronger protections from foreign competitors, up to and including a ban on sales of teas imported by European shippers; others merely requested “to be allowed a farther time for payment of the duties on a quantity of teas imported.” Though there was a strong sentiment in the early Congresses that the development of the China trade was of great importance as a means to national prosperity and security – as “a trade sought after by all the world” it seemed obvious to some members that it should be protected, one way or another – this feeling was not sufficiently shared to move more protective legislation out of committee.

Even Alexander Hamilton, who is sometimes presented as the protectionist avatar of American commerce, was ambivalent. Replying to a request to evaluate a petition from the “merchants of Philadelphia trading to India and China,” he told the House of Representatives that “the trade to India and China appears to lay claim to the patronage of the Government” but “a full and accurate examination should be had into the nature and tendency of that trade” before any “encouragement” or protection could be offered.9 In other words, Hamilton kicked the can down the road, a move likely made out of concern for maintaining government income – as Hamilton knew, protecting the American trade too aggressively was a sure way to choke off the stream of revenue that flowed into the Treasury from the high duties paid by foreign importers (who paid 50% higher duties on teas, and 700% higher tonnage duties). However, in a different report on a similar petition, the Secretary of the Treasury did suggest another option: that Congress extend “credit for the duties” due on tea.10

Though Hamilton’s advice was hardly gospel – Madison and other proto-Republicans in the House were at pains to reduce the his influence in all things financial – in this matter the legislature followed his lead and chose to amend only the administrative aspects of the tariff law. Specifically, Congress extended the amount of time American merchants could store imported teas without paying duties, first from nothing to one full year, and then later from one year to two; all the importer had to do was give the port collector a bond for future payments, which could be made as the tea was sold.11

In the event, this new system worked well: by offering merchants two-year interest-free loans on their taxes, the Federal Government provided the flexibility needed to keep the trade alive beyond one season of oversupply, while at the same time effectively securing an important long-term source of revenue. It was a neat piece of governance which allowed Congress leeway to raise taxes on teas repeatedly over the next few decades, without fear of harming the trade, as merchants would always have time to adjust to new market conditions.

~

So what does this have to do with the debt ceiling negotiations? Well, I think the case of the tea tariffs offers us some insight into the particular ways our own political scene differs from those of the Revolutionary era. For the significant conservative political force in our own moment, the financial reputation of the U.S. is worth chancing in order to achieve a significant change in policy, whereas in the founding decades, for partisans of every stripe, any policy was worth changing in order to secure a sounder financial reputation.

Moreover, I think the audacity of the move – forego taxes in order to secure them! – is one worth remembering in any era where a flexible approach to ideology in governance seems rare.

(It’s also important to remember that – two centuries of hagiography to the contrary – this was not the compromise of a uniquely enlightened age. Recall that a key architect of this decision, Hamilton, got himself shot and killed by a political rival – something that is now, thankfully, nearly unheard of. And trust me when I say that the rhetoric exchanged between partisans, of this or almost any other age of American politics, is quite comparable to ours, in terms of outright viciousness; though earlier generations were perhaps more creative…)

More germane to my own inside baseball, the tea tariff decision overthrows the bipolar conclusions drawn in the current literature on the China trade. In contrast to writers who argue (implicitly or explicitly) that Asian commerce impinged only slightly if at all on the politics of early America, the care policymakers took with the tea trade suggests that concern with economic connections with Asia was most certainly a force in political debate. On the other hand, the government’s strategic deafness to merchant’s calls for commercial protection from competition belies accusations leveled by later politicians and historians that the:

“records of American legislation bear the most satisfactory testimony of the transcendent influence of the mercantile interests, and of the unceasing exertions made to fence it round with every species of protection the government could bestow which secured to the tonnage of our merchants, a monopoly of the whole of the China trade – and gave them paramount advantages in all other foreign trade.”12

Neither a controlling force in government nor a puff of air, the China trade was nonetheless an important component of the nation’s most crucial, and endlessly controversial, revenue laws. And the way the revenue it generated was flexibly supervised within the tariff laws typifies the pragmatic approach that early American politicians took to governing what they hoped would be a nation simultaneously prosperous and free.


 

1) For example: http://www.tnr.com/blog/jonathan-chait/91347/the-14th-amendment-solution

2) How’s that for Federal intervention into private life! 1 Stat. 373 (June 5, 1794), Chapter 45, 3 Congress, Session 1, “An Act: Laying duties upon carriages for the conveyance of persons.”

3) Among all forms of overseas commerce, only the direct trade in China goods was singled out for protection, distinguished by the trade route rather than what commodity trafficked. Taxes on Asian goods – teas, China ware, etc. – were the lowest if they were imported by Americans directly from Canton, higher if they were brought by Americans from Europe, and highest if they were imported by foreigners to the U.S.

4) Taxes on imported wine and hard alcohol were the other key supports of the system.

5) 1 Stat. 25, Chapter 2, 1 Congress, Session 1, An Act: For laying a duty on goods, wares, and merchandises imported into the United States. (July 4, 1789); 1 Stat 145, Chapter 35, 1 Congress, Session 2, An Act: To provide more effectually for the collection of the duties imposed by law on goods, wares, and merchandise imported into the United States, and on the tonnage of ships or vessels. (Aug. 4, 1790); 1 Stat. 180, Chapter 39, 1 Congress, Session 2, An Act: Making further provision for the payment of the debt of the United States. (Aug 10, 1790); 1 Stat 219, Chapter 26, 1 Congress, Session 3, An Act: Making farther provision for the collection of the duties by law imposed on teas, and to prolong the term for the payment of the duties on wines. (Mar. 3, 1791); 1 Stat 411, Chapter 17, 3 Congress, Session 2, An Act: Supplementary to the several acts imposing duties on goods, wares, and merchandises imported into the United States. (Jan. 29, 1795); 1 Stat 503, Chapter 10, 4 Congress, Session 2, An Act: For raising a further sum of money by additional duties on certain articles imported, and for other purposes. (Mar. 3, 1797); etc.

6) As one republican columnist explained, the political implications of taxes mattered, not what they taxed: “people who revolted against that innovation [the 1773 Tea Act], certainly not for the magnitude of the duty, but from a wise anticipation of the horrid train for which it was calculated to open the way….” “For the National Gazette, On the Secretary’s Report on the Excise,” National Gazette, 26 April 1792

7) “Petition of Elias Hasket Derby, Salem, Mass., 10 June 1789,” in Kenneth R. Bowling, William Charles DiGiacomantonio, and Charlene Bangs Bickford, eds., Petition Histories and Nonlegislative Official Documents, vol. 8, Documentary History of the First Federal Congress of the United States of America, 1789-1791 (Baltimore: Johns Hopkins University Press, 1998), 407.

8.) Fri, Feb 24, 1792 (1st Sess), Journal of the House of Representatives, 520

9) Emphasis mine. United States Congress, American State Papers: Finance, ed. Walter Lowrie and Matthew St. Clair Clarke (Washington, D.C: Gales and Seaton, 1832), 1:107, http://memory.loc.gov/ammem/amlaw/lwsp.html; “Report of the Treasury of the Secretary, 10 February 1791,” in Bowling, DiGiacomantonio, and Bickford, Petition Histories and Nonlegislative Official Documents, 8:382-383.

10) “Report of the Secretary of the Treasury, 2 March 1791,”Bowling, DiGiacomantonio, and Bickford, Petition Histories and Nonlegislative Official Documents, 8:411.

11) 1 Stat. 145, Chapter 35, 1 Congress, Session 2, An Act: To provide more effectually for the collection of the duties imposed by law on goods, wares, and merchandise imported into the United States, and on the tonnage of ships or vessels. (Aug. 4, 1790); 1 Stat. 219, Chapter 26, 1 Congress, Session 3, An Act: Making farther provision for the collection of the duties by law imposed on teas, and to prolong the term for the payment of the duties on wines. (Mar. 3, 1791)

12) Mathew Carey, The New Olive Branch, or, An Attempt to Establish an Identity of Interest Between Agriculture, Manufactures, and Commerce and to Prove, That a Large Portion of the Manufacturing Industry of This Nation Has Been Sacrificed to Commerce, and That Commerce Has Suffered by This Policy Nearly as Much as Manufactures (Philadelphia: M. Carey & Son, 1820), 213-214, http://catalog.hathitrust.org/Record/006512105. Carey’s summary of the early Congress’s favoritism toward the mercantile interest in general and the China trade in particular is repeated in Edward Dewey Graham, American Ideas of a Special Relationship with China, 1784-1900, Harvard dissertations in American history and political science (New York: Garland Publishing, Inc., 1988); Edward Dewey Graham, “Special Interests and the Early China Trade,” Michigan Academician 6, no. 2 (Fall 1973): 233-242.

Archival Follies, History and Historians, Now in Actual Work

Ex Readex: Redux

Or, the world in a grain of ads

You’ll recall that in my last I wondered “What am I getting wrong?” — a big question, for sure, with many and varied answers, as friends, acquaintances and passer-by would be happy to tell you. But in this case I was specifically concerned with what I was misunderstanding about the search results I was receiving from a Readex database, America’s Historical Newspapers.

Well, you’ll be pleased to know that Readex, in the person of their marketing director, David Loiterstein, was kind enough to get in touch by e-mail and tell me exactly that. And the answer? Granularity.

Basically, the AHN database does not consistently break down advertising sections at the same level of granularity; it has changed over time. As David explained:

Initially, particularly for the 18th century in which the first series of newspapers was so heavily concentrated, we identified individually every advertisement on every page; however, in later series multiple contiguous advertisements were identified in groups.

So: sometimes individual ads count as individual “articles,” sometimes a multiple-ad block count as one, and sometimes entire columns of ads count as one unit; and the granularity of the ads goes down, generally speaking, over time. Which means that my results — which included all article types, including ads — were skewed by the ways ads are counted.

David provided a graph of his own, illustrating this effect, and suggesting a way to get clear of it (reproduced here with permission):
AdBlocker
I’ll let him explain:

This approach seen above—in which advertisements are isolated and an aggregate number of the other article types is counted separately—provides a more representative measure of available “texts.” While the data does in fact indicate fewer “articles” available between 1820 and 1850 in what is otherwise a steady increase in articles available between 1690 and 1819 and between 1850 and 1922. The declining number of ads as a percentage of “articles” or “text” is a result not of fewer ads but the changing approach by which we identify them.

Thus, practically speaking, if you want to get some kind of a baseline for how representative a given search’s results are, you’re going to have to sacrifice including ads in those search results. Not ideal, of course, but much better than not knowing what your results mean. In addition to responding directly to this specific question, David also mentioned that Readex was working to update the Readex Help section, and fix the discrepancy between the two portals I had noticed.

So where does this leave us?

Well, with a much better understanding of how one of the most important databases in Early American historical research functions, for which I am grateful to David and his colleagues for their quick response and kind explanation.

I would note, though, that even using the new numbers, the curve still shows an unexpected dip in the 1820s and 1830s — the heart of the Jacksonian era, where most historians would tell you that print, and especially newspapers, exploded. As I said before, this is not something I think unique to Readex, but rather an artifact of the way many digitization projects have done triage (or, alternately, it might be proof that print output indeed declined, in which case steam-powered presses were not actually all that important in the development of American democracy! But let’s hope not, as then we’d have to revise a lot of historiography…).

In any case, all good factors to keep in mind when trying to use large collections to buttress claims about relative representativeness, ubiquity, or uniqueness. And now on to new and exciting problems…

History and Historians, Now in Actual Work

Ex Readex: Not Much?

Or, Caveat NewsBank

UPDATE: See the subsequent post for the thrilling reveal!

In harmony with one of the recent memes floating around the world of digital history — the happy attention to some of what historians don’t know about database design, how particular databases are missing parts of texts, within particular series, and proposals for how we might directly address this issue, as a collective, I thought it might be worthwhile to add my own experience to the pile.

Briefly stated: one of the standard databases, Readex’s America’s Historical Newspapers, seems to have a shockingly low number of texts available for the Jacksonian-to-Antebellum period — more, even, than their own product descriptions (which emphasize the coverage of particular years) would lead you to believe. Here’s a picture:

(see below for a table with the raw numbers)

But before I get too far in here, let me emphasize the caveat: I say “seems” for a couple of reasons.

First and foremost: I may be completely misunderstanding something about how searches work in this database. The y-axis on the above graph is the number of “hits” a blank or wildcard (* or ?) search in the fulltext field of the database returned for 5 year intervals (blanks and wildcards returned equal numbers). This may or may not be the same as the number of “documents” (articles) or “images” in the database; though I should think it would be.

Second, the results I’m getting seem to run counter to some of the statistics Readex itself provides about the component databases searched by “America’s Historical Newspapers.” See, for example, what they say about the number of images in each of the seven (7!) component series of “Early American Newspapers” in the product description. The numbers of images available seem out of whack with what you’d expect…but since these are such big dates ranges, it could be that what I’ve found is still true for this period; I don’t know. There also seems to be a discrepancy between the these figures and those produced on different search pages available on the Readex site.

On another level, though, all this jibes with something I’ve long suspected — the digitization of print materials from the U.S. follows an uneven U-shaped curve, where the trough is roughly 1800 to 1850. Broadly speaking, it seems like every possible scrap of material from the colonial and revolutionary era has been digitized, extending, in the case of the Founder’s Paper’s projects (e.g. Rotunda) far into manuscript materials. Then, just as the print explosion begins in the U.S., digitized materials drop off, picking up again with the Civil War, and increasing as we approach the 20th-century. That seems to be borne out here (or, at least as far as I was willing to go with the data entry).

This curve is in many ways totally understandable; there are fewer colonial and revolutionary periodicals, so why not be complete about it? And obviously there is more interest in the more recent past (perhaps the post-war stuff is digitized because it’s close enough that it might be good for local histories and genealogical work?). But on another level, it’s troubling; especially given how historians are beginning to use this and like databases to talk about the appearance of particular terms. Comprehensiveness, esp. relative comprehensiveness really matters there.

That’s how I happened on this case. I came across this oddity while trying to control for changes in the size of the database while tracking changes in the occurrence of a particular set of terms.1

What really shocks me about the numbers I’ve pulled out of AHN — which is, to my knowledge, far and away the most comprehensive database for this period there is — was how much the absolute number of articles scanned is lower over time. I figured, at best, that the coverage was reduced only in terms of geographic range, or narrowed by a focus on particular publishers; only New York, Philadelphia and Boston well-covered, for example, and not the vast West and South. But apparently (and again, I want to emphasize the tentative nature of my conclusion here), that was dead wrong.

The upshot: for given values of the “Early Republic,” digitization is still a ways away, and we should not trust any database’s comprehensiveness — even if, at first glance (or, in my case, continuous usage over aargh, years) seems to suggest that it contains a lot of material.

Okay, so now some blegs: Any thoughts on this? What am I getting wrong? As I said, I can’t help but think this puts a major crimp in what we can use these databases for, in terms of reliability — but I’d be glad to have any mistakes I’m making here pointed out, the sooner the better.

1.) If you’re interested, the string I was searching was this horrible stew of syntax:

(“East Indies” OR “East India” OR “East Indian” OR China OR Chinese OR Orient OR Orient*) NEAR25(specie OR silver OR dollar? OR currency OR circulati*) AND (trade OR commerce) NEAR25(specie OR silver OR dollar? OR currency OR circulati*) AND (drai* OR expor*) NEAR25(specie OR silver OR dollar? OR currency OR circulati*)

Suggestions on how to improve that monster would very welcome.

2.)There is also a discrepancy between two portals to search the Readex newspaper database. When I’ve searched only newspapers from the Archive of Americana portal, I consistently get higher returns than if I had searched America’s Historical Newspapers directly. The difference is potentially significant — in the period 1835-1839, AHN returns 1,702,150 hits compared to AA’s 1,933,685, a difference of 231,535, or 13.6%.

I’m not sure why this is so; the two searches say they are tapping into the same databases, to wit:

AA’s search says it includes:

Early American Newspapers, Series 1 (1690 – 1876), Early American Newspapers, Series 2 (1758 – 1900), Early American Newspapers, Series 3 (1829 – 1922), Early American Newspapers, Series 4 (1756 – 1922), Early American Newspapers, Series 5 (1777 – 1922), Early American Newspapers, Series 6 (1741 – 1922), Early American Newspapers, Series 7 (1773 – 1922), Hispanic American Newspapers (1808 – 1980), African American Newspapers, 1827-1998 (1827 – 1998) and Ethnic American Newspapers from the Balch Collection (1808 – 1980).

While AHN’s claims:

Early American Newspapers Series 1 – 7, 1690-1922; African American Newspapers, 1827-1998; Ethnic American Newspapers from the Balch Collection, 1799-1971; Hispanic American Newspapers, 1808-1980 and Selected Historical Newspapers.

That seems comparable to me. If anything, the AHN search should include more, what with the inclusion of “Selected Historical Newspapers.”

I’m planning to e-mail the Readex people to find out what’s going on — and what I might be missing — but any suggestions in the meantime are welcome.


Raw Numbers

(Note: these figures come from searches performed using the AHN portal, not the AA portal)

Years

Total “Hits” (articles?)

1795-1799

3,626,530

1800-1804

4,422,965

1805-1809

5,041,412

1810-1814

4,838,756

1815-1819

6,449,231

1820-1824

3,856,979

1825-1829

2,338,139

1830-1834

1,991,623

1835-1839

1,702,150

1840-1844

1,907,799

1845-1849

2,398,359

1850-1854

2,682,211

1855-1859

2,762,811

1860-1864

2,757,069

1865-1869

3,725,627

1870-1874

4,531,278

1875-1879

4,566,376

1880-1884

5,015,152

1885-1889

6,958,484

1890-1894

9,701,775

1895-1899

11,397,028