6.4 Inaugural Corpus USA
The readtext package comes with various datasets. We specify the path to where to find the datasets and upload them
6.4.2 Create a corpus
## Corpus consisting of 5 documents and 3 docvars.
## text1 :
## "Fellow-Citizens of the Senate and of the House of Representa..."
##
## text2 :
## "Fellow citizens, I am again called upon by the voice of my c..."
##
## text3 :
## "When it was first perceived, in early times, that no middle ..."
##
## text4 :
## "Friends and Fellow Citizens: Called upon to undertake the du..."
##
## text5 :
## "Proceeding, fellow citizens, to that qualification which the..."6.4.2.1 Summary
## Corpus consisting of 5 documents, showing 5 documents:
##
## Text Types Tokens Sentences Year President FirstName
## text1 625 1538 23 1789 Washington George
## text2 96 147 4 1793 Washington George
## text3 826 2578 37 1797 Adams John
## text4 717 1927 41 1801 Jefferson Thomas
## text5 804 2381 45 1805 Jefferson Thomas6.4.2.2 Editing docnames
docid <- paste(dat_inaug$Year,
dat_inaug$FirstName,
dat_inaug$President, sep = " ")
docnames(dat_inaug_corpus) <- docid
print(dat_inaug_corpus)## Corpus consisting of 5 documents and 3 docvars.
## 1789 George Washington :
## "Fellow-Citizens of the Senate and of the House of Representa..."
##
## 1793 George Washington :
## "Fellow citizens, I am again called upon by the voice of my c..."
##
## 1797 John Adams :
## "When it was first perceived, in early times, that no middle ..."
##
## 1801 Thomas Jefferson :
## "Friends and Fellow Citizens: Called upon to undertake the du..."
##
## 1805 Thomas Jefferson :
## "Proceeding, fellow citizens, to that qualification which the..."6.4.2.3 Accessing parts of corpus
## [1] "Fellow-Citizens of the Senate and of the House of Representatives:\n\nAmong the vicissitudes incident to life no event could have filled me with greater anxieties than that of which the notification was transmitted by your order, and received on the 14th day of the present month. On the one hand, I was summoned by my Country, whose voice I can never hear but with veneration and love, from a retreat which I had chosen with the fondest predilection, and, in my flattering hopes, with an immutable decision, as the asylum of my declining years -- a retreat which was rendered every day more necessary as well as more dear to me by the addition of habit to inclination, and of frequent interruptions in my health to the gradual waste committed on it by time. On the other hand, the magnitude and difficulty of the trust to which the voice of my country called me, being sufficient to awaken in the wisest and most experienced of her citizens a distrustful scrutiny into his qualifications, could not but overwhelm with despondence one who (inheriting inferior endowments from nature and unpracticed in the duties of civil administration) ought to be peculiarly conscious of his own deficiencies. In this conflict of emotions all I dare aver is that it has been my faithful study to collect my duty from a just appreciation of every circumstance by which it might be affected. All I dare hope is that if, in executing this task, I have been too much swayed by a grateful remembrance of former instances, or by an affectionate sensibility to this transcendent proof of the confidence of my fellow citizens, and have thence too little consulted my incapacity as well as disinclination for the weighty and untried cares before me, my error will be palliated by the motives which mislead me, and its consequences be judged by my country with some share of the partiality in which they originated.\n\nSuch being the impressions under which I have, in obedience to the public summons, repaired to the present station, it would be peculiarly improper to omit in this first official act my fervent supplications to that Almighty Being who rules over the universe, who presides in the councils of nations, and whose providential aids can supply every human defect, that His benediction may consecrate to the liberties and happiness of the people of the United States a Government instituted by themselves for these essential purposes, and may enable every instrument employed in its administration to execute with success the functions allotted to his charge. In tendering this homage to the Great Author of every public and private good, I assure myself that it expresses your sentiments not less than my own, nor those of my fellow citizens at large less than either. No people can be bound to acknowledge and adore the Invisible Hand which conducts the affairs of men more than those of the United States. Every step by which they have advanced to the character of an independent nation seems to have been distinguished by some token of providential agency; and in the important revolution just accomplished in the system of their united government the tranquil deliberations and voluntary consent of so many distinct communities from which the event has resulted can not be compared with the means by which most governments have been established without some return of pious gratitude, along with an humble anticipation of the future blessings which the past seem to presage. These reflections, arising out of the present crisis, have forced themselves too strongly on my mind to be suppressed. You will join with me, I trust, in thinking that there are none under the influence of which the proceedings of a new and free government can more auspiciously commence.\n\nBy the article establishing the executive department it is made the duty of the President \"to recommend to your consideration such measures as he shall judge necessary and expedient.\" The circumstances under which I now meet you will acquit me from entering into that subject further than to refer to the great constitutional charter under which you are assembled, and which, in defining your powers, designates the objects to which your attention is to be given. It will be more consistent with those circumstances, and far more congenial with the feelings which actuate me, to substitute, in place of a recommendation of particular measures, the tribute that is due to the talents, the rectitude, and the patriotism which adorn the characters selected to devise and adopt them. In these honorable qualifications I behold the surest pledges that as on one side no local prejudices or attachments, no separate views nor party animosities, will misdirect the comprehensive and equal eye which ought to watch over this great assemblage of communities and interests, so, on another, that the foundation of our national policy will be laid in the pure and immutable principles of private morality, and the preeminence of free government be exemplified by all the attributes which can win the affections of its citizens and command the respect of the world. I dwell on this prospect with every satisfaction which an ardent love for my country can inspire, since there is no truth more thoroughly established than that there exists in the economy and course of nature an indissoluble union between virtue and happiness; between duty and advantage; between the genuine maxims of an honest and magnanimous policy and the solid rewards of public prosperity and felicity; since we ought to be no less persuaded that the propitious smiles of Heaven can never be expected on a nation that disregards the eternal rules of order and right which Heaven itself has ordained; and since the preservation of the sacred fire of liberty and the destiny of the republican model of government are justly considered, perhaps, as deeply, as finally, staked on the experiment entrusted to the hands of the American people.\n\nBesides the ordinary objects submitted to your care, it will remain with your judgment to decide how far an exercise of the occasional power delegated by the fifth article of the Constitution is rendered expedient at the present juncture by the nature of objections which have been urged against the system, or by the degree of inquietude which has given birth to them. Instead of undertaking particular recommendations on this subject, in which I could be guided by no lights derived from official opportunities, I shall again give way to my entire confidence in your discernment and pursuit of the public good; for I assure myself that whilst you carefully avoid every alteration which might endanger the benefits of an united and effective government, or which ought to await the future lessons of experience, a reverence for the characteristic rights of freemen and a regard for the public harmony will sufficiently influence your deliberations on the question how far the former can be impregnably fortified or the latter be safely and advantageously promoted.\n\nTo the foregoing observations I have one to add, which will be most properly addressed to the House of Representatives. It concerns myself, and will therefore be as brief as possible. When I was first honored with a call into the service of my country, then on the eve of an arduous struggle for its liberties, the light in which I contemplated my duty required that I should renounce every pecuniary compensation. From this resolution I have in no instance departed; and being still under the impressions which produced it, I must decline as inapplicable to myself any share in the personal emoluments which may be indispensably included in a permanent provision for the executive department, and must accordingly pray that the pecuniary estimates for the station in which I am placed may during my continuance in it be limited to such actual expenditures as the public good may be thought to require.\n\nHaving thus imparted to you my sentiments as they have been awakened by the occasion which brings us together, I shall take my present leave; but not without resorting once more to the benign Parent of the Human Race in humble supplication that, since He has been pleased to favor the American people with opportunities for deliberating in perfect tranquillity, and dispositions for deciding with unparalleled unanimity on a form of government for the security of their union and the advancement of their happiness, so His divine blessing may be equally conspicuous in the enlarged views, the temperate consultations, and the wise measures on which the success of this Government must depend. "## [1] "Fellow-Citizens of the Senate and of the House of Representatives:\n\nAmong the vicissitudes incident to life no event could have filled me with greater anxieties than that of which the notification was transmitted by your order, and received on the 14th day of the present month. On the one hand, I was summoned by my Country, whose voice I can never hear but with veneration and love, from a retreat which I had chosen with the fondest predilection, and, in my flattering hopes, with an immutable decision, as the asylum of my declining years -- a retreat which was rendered every day more necessary as well as more dear to me by the addition of habit to inclination, and of frequent interruptions in my health to the gradual waste committed on it by time. On the other hand, the magnitude and difficulty of the trust to which the voice of my country called me, being sufficient to awaken in the wisest and most experienced of her citizens a distrustful scrutiny into his qualifications, could not but overwhelm with despondence one who (inheriting inferior endowments from nature and unpracticed in the duties of civil administration) ought to be peculiarly conscious of his own deficiencies. In this conflict of emotions all I dare aver is that it has been my faithful study to collect my duty from a just appreciation of every circumstance by which it might be affected. All I dare hope is that if, in executing this task, I have been too much swayed by a grateful remembrance of former instances, or by an affectionate sensibility to this transcendent proof of the confidence of my fellow citizens, and have thence too little consulted my incapacity as well as disinclination for the weighty and untried cares before me, my error will be palliated by the motives which mislead me, and its consequences be judged by my country with some share of the partiality in which they originated.\n\nSuch being the impressions under which I have, in obedience to the public summons, repaired to the present station, it would be peculiarly improper to omit in this first official act my fervent supplications to that Almighty Being who rules over the universe, who presides in the councils of nations, and whose providential aids can supply every human defect, that His benediction may consecrate to the liberties and happiness of the people of the United States a Government instituted by themselves for these essential purposes, and may enable every instrument employed in its administration to execute with success the functions allotted to his charge. In tendering this homage to the Great Author of every public and private good, I assure myself that it expresses your sentiments not less than my own, nor those of my fellow citizens at large less than either. No people can be bound to acknowledge and adore the Invisible Hand which conducts the affairs of men more than those of the United States. Every step by which they have advanced to the character of an independent nation seems to have been distinguished by some token of providential agency; and in the important revolution just accomplished in the system of their united government the tranquil deliberations and voluntary consent of so many distinct communities from which the event has resulted can not be compared with the means by which most governments have been established without some return of pious gratitude, along with an humble anticipation of the future blessings which the past seem to presage. These reflections, arising out of the present crisis, have forced themselves too strongly on my mind to be suppressed. You will join with me, I trust, in thinking that there are none under the influence of which the proceedings of a new and free government can more auspiciously commence.\n\nBy the article establishing the executive department it is made the duty of the President \"to recommend to your consideration such measures as he shall judge necessary and expedient.\" The circumstances under which I now meet you will acquit me from entering into that subject further than to refer to the great constitutional charter under which you are assembled, and which, in defining your powers, designates the objects to which your attention is to be given. It will be more consistent with those circumstances, and far more congenial with the feelings which actuate me, to substitute, in place of a recommendation of particular measures, the tribute that is due to the talents, the rectitude, and the patriotism which adorn the characters selected to devise and adopt them. In these honorable qualifications I behold the surest pledges that as on one side no local prejudices or attachments, no separate views nor party animosities, will misdirect the comprehensive and equal eye which ought to watch over this great assemblage of communities and interests, so, on another, that the foundation of our national policy will be laid in the pure and immutable principles of private morality, and the preeminence of free government be exemplified by all the attributes which can win the affections of its citizens and command the respect of the world. I dwell on this prospect with every satisfaction which an ardent love for my country can inspire, since there is no truth more thoroughly established than that there exists in the economy and course of nature an indissoluble union between virtue and happiness; between duty and advantage; between the genuine maxims of an honest and magnanimous policy and the solid rewards of public prosperity and felicity; since we ought to be no less persuaded that the propitious smiles of Heaven can never be expected on a nation that disregards the eternal rules of order and right which Heaven itself has ordained; and since the preservation of the sacred fire of liberty and the destiny of the republican model of government are justly considered, perhaps, as deeply, as finally, staked on the experiment entrusted to the hands of the American people.\n\nBesides the ordinary objects submitted to your care, it will remain with your judgment to decide how far an exercise of the occasional power delegated by the fifth article of the Constitution is rendered expedient at the present juncture by the nature of objections which have been urged against the system, or by the degree of inquietude which has given birth to them. Instead of undertaking particular recommendations on this subject, in which I could be guided by no lights derived from official opportunities, I shall again give way to my entire confidence in your discernment and pursuit of the public good; for I assure myself that whilst you carefully avoid every alteration which might endanger the benefits of an united and effective government, or which ought to await the future lessons of experience, a reverence for the characteristic rights of freemen and a regard for the public harmony will sufficiently influence your deliberations on the question how far the former can be impregnably fortified or the latter be safely and advantageously promoted.\n\nTo the foregoing observations I have one to add, which will be most properly addressed to the House of Representatives. It concerns myself, and will therefore be as brief as possible. When I was first honored with a call into the service of my country, then on the eve of an arduous struggle for its liberties, the light in which I contemplated my duty required that I should renounce every pecuniary compensation. From this resolution I have in no instance departed; and being still under the impressions which produced it, I must decline as inapplicable to myself any share in the personal emoluments which may be indispensably included in a permanent provision for the executive department, and must accordingly pray that the pecuniary estimates for the station in which I am placed may during my continuance in it be limited to such actual expenditures as the public good may be thought to require.\n\nHaving thus imparted to you my sentiments as they have been awakened by the occasion which brings us together, I shall take my present leave; but not without resorting once more to the benign Parent of the Human Race in humble supplication that, since He has been pleased to favor the American people with opportunities for deliberating in perfect tranquillity, and dispositions for deciding with unparalleled unanimity on a form of government for the security of their union and the advancement of their happiness, so His divine blessing may be equally conspicuous in the enlarged views, the temperate consultations, and the wise measures on which the success of this Government must depend. "6.4.3 Basic manipulations
By default, a corpus is created based on the “documents” (= lines). We can reshape it to show “sentences” or “paragraphs”.
6.4.3.1 Sentences
6.4.3.1.1 Transform
## Corpus consisting of 150 documents and 3 docvars.
## 1789 George Washington.1 :
## "Fellow-Citizens of the Senate and of the House of Representa..."
##
## 1789 George Washington.2 :
## "On the one hand, I was summoned by my Country, whose voice I..."
##
## 1789 George Washington.3 :
## "On the other hand, the magnitude and difficulty of the trust..."
##
## 1789 George Washington.4 :
## "In this conflict of emotions all I dare aver is that it has ..."
##
## 1789 George Washington.5 :
## "All I dare hope is that if, in executing this task, I have b..."
##
## 1789 George Washington.6 :
## "Such being the impressions under which I have, in obedience ..."
##
## [ reached max_ndoc ... 144 more documents ]6.4.3.1.2 Summary
## Corpus consisting of 150 documents, showing 100 documents:
##
## Text Types Tokens Sentences Year President FirstName
## 1789 George Washington.1 39 49 1 1789 Washington George
## 1789 George Washington.2 63 98 1 1789 Washington George
## 1789 George Washington.3 58 75 1 1789 Washington George
## 1789 George Washington.4 32 35 1 1789 Washington George
## 1789 George Washington.5 68 96 1 1789 Washington George
## 1789 George Washington.6 81 112 1 1789 Washington George
## 1789 George Washington.7 36 41 1 1789 Washington George
## 1789 George Washington.8 23 26 1 1789 Washington George
## 1789 George Washington.9 67 94 1 1789 Washington George
## 1789 George Washington.10 21 22 1 1789 Washington George
## 1789 George Washington.11 30 33 1 1789 Washington George
## 1789 George Washington.12 27 32 1 1789 Washington George
## 1789 George Washington.13 39 51 1 1789 Washington George
## 1789 George Washington.14 40 58 1 1789 Washington George
## 1789 George Washington.15 72 100 1 1789 Washington George
## 1789 George Washington.16 97 150 1 1789 Washington George
## 1789 George Washington.17 49 66 1 1789 Washington George
## 1789 George Washington.18 84 116 1 1789 Washington George
## 1789 George Washington.19 20 22 1 1789 Washington George
## 1789 George Washington.20 12 13 1 1789 Washington George
## 1789 George Washington.21 37 44 1 1789 Washington George
## 1789 George Washington.22 60 85 1 1789 Washington George
## 1789 George Washington.23 88 120 1 1789 Washington George
## 1793 George Washington.1 21 23 1 1793 Washington George
## 1793 George Washington.2 33 41 1 1793 Washington George
## 1793 George Washington.3 15 19 1 1793 Washington George
## 1793 George Washington.4 52 64 1 1793 Washington George
## 1797 John Adams.1 65 83 1 1797 Adams John
## 1797 John Adams.2 65 97 1 1797 Adams John
## 1797 John Adams.3 26 33 1 1797 Adams John
## 1797 John Adams.4 37 48 1 1797 Adams John
## 1797 John Adams.5 47 56 1 1797 Adams John
## 1797 John Adams.6 63 102 1 1797 Adams John
## 1797 John Adams.7 23 26 1 1797 Adams John
## 1797 John Adams.8 31 39 1 1797 Adams John
## 1797 John Adams.9 16 17 1 1797 Adams John
## 1797 John Adams.10 23 30 1 1797 Adams John
## 1797 John Adams.11 49 66 1 1797 Adams John
## 1797 John Adams.12 34 40 1 1797 Adams John
## 1797 John Adams.13 40 56 1 1797 Adams John
## 1797 John Adams.14 25 27 1 1797 Adams John
## 1797 John Adams.15 43 58 1 1797 Adams John
## 1797 John Adams.16 38 50 1 1797 Adams John
## 1797 John Adams.17 37 58 1 1797 Adams John
## 1797 John Adams.18 16 17 1 1797 Adams John
## 1797 John Adams.19 84 123 1 1797 Adams John
## 1797 John Adams.20 18 21 1 1797 Adams John
## 1797 John Adams.21 30 35 1 1797 Adams John
## 1797 John Adams.22 10 10 1 1797 Adams John
## 1797 John Adams.23 23 28 1 1797 Adams John
## 1797 John Adams.24 26 33 1 1797 Adams John
## 1797 John Adams.25 17 17 1 1797 Adams John
## 1797 John Adams.26 26 36 1 1797 Adams John
## 1797 John Adams.27 34 46 1 1797 Adams John
## 1797 John Adams.28 36 51 1 1797 Adams John
## 1797 John Adams.29 29 45 1 1797 Adams John
## 1797 John Adams.30 37 42 1 1797 Adams John
## 1797 John Adams.31 80 128 1 1797 Adams John
## 1797 John Adams.32 41 61 1 1797 Adams John
## 1797 John Adams.33 26 28 1 1797 Adams John
## 1797 John Adams.34 22 30 1 1797 Adams John
## 1797 John Adams.35 329 808 1 1797 Adams John
## 1797 John Adams.36 51 75 1 1797 Adams John
## 1797 John Adams.37 41 58 1 1797 Adams John
## 1801 Thomas Jefferson.1 65 96 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.2 65 98 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.3 41 50 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.4 43 58 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.5 59 87 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.6 38 56 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.7 13 16 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.8 21 22 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.9 39 49 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.10 51 71 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.11 10 12 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.12 12 12 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.13 8 10 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.14 42 46 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.15 56 77 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.16 4 4 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.17 11 14 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.18 29 40 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.19 16 16 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.20 12 13 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.21 14 14 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.22 6 6 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.23 20 25 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.24 104 178 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.25 42 54 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.26 17 20 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.27 36 46 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.28 20 23 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.29 146 271 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.30 22 23 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.31 15 17 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.32 45 66 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.33 13 15 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.34 39 51 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.35 50 64 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.36 10 10 1 1801 Jefferson Thomas6.4.3.1.3 Subset
We can subset sentences with 10 or more words
dat_inaug_corpus_sent_long <- corpus_subset(dat_inaug_corpus_sent, ntoken(dat_inaug_corpus_sent) >= 10)
ndoc(dat_inaug_corpus_sent_long)## [1] 148## Corpus consisting of 148 documents, showing 100 documents:
##
## Text Types Tokens Sentences Year President FirstName
## 1789 George Washington.1 39 49 1 1789 Washington George
## 1789 George Washington.2 63 98 1 1789 Washington George
## 1789 George Washington.3 58 75 1 1789 Washington George
## 1789 George Washington.4 32 35 1 1789 Washington George
## 1789 George Washington.5 68 96 1 1789 Washington George
## 1789 George Washington.6 81 112 1 1789 Washington George
## 1789 George Washington.7 36 41 1 1789 Washington George
## 1789 George Washington.8 23 26 1 1789 Washington George
## 1789 George Washington.9 67 94 1 1789 Washington George
## 1789 George Washington.10 21 22 1 1789 Washington George
## 1789 George Washington.11 30 33 1 1789 Washington George
## 1789 George Washington.12 27 32 1 1789 Washington George
## 1789 George Washington.13 39 51 1 1789 Washington George
## 1789 George Washington.14 40 58 1 1789 Washington George
## 1789 George Washington.15 72 100 1 1789 Washington George
## 1789 George Washington.16 97 150 1 1789 Washington George
## 1789 George Washington.17 49 66 1 1789 Washington George
## 1789 George Washington.18 84 116 1 1789 Washington George
## 1789 George Washington.19 20 22 1 1789 Washington George
## 1789 George Washington.20 12 13 1 1789 Washington George
## 1789 George Washington.21 37 44 1 1789 Washington George
## 1789 George Washington.22 60 85 1 1789 Washington George
## 1789 George Washington.23 88 120 1 1789 Washington George
## 1793 George Washington.1 21 23 1 1793 Washington George
## 1793 George Washington.2 33 41 1 1793 Washington George
## 1793 George Washington.3 15 19 1 1793 Washington George
## 1793 George Washington.4 52 64 1 1793 Washington George
## 1797 John Adams.1 65 83 1 1797 Adams John
## 1797 John Adams.2 65 97 1 1797 Adams John
## 1797 John Adams.3 26 33 1 1797 Adams John
## 1797 John Adams.4 37 48 1 1797 Adams John
## 1797 John Adams.5 47 56 1 1797 Adams John
## 1797 John Adams.6 63 102 1 1797 Adams John
## 1797 John Adams.7 23 26 1 1797 Adams John
## 1797 John Adams.8 31 39 1 1797 Adams John
## 1797 John Adams.9 16 17 1 1797 Adams John
## 1797 John Adams.10 23 30 1 1797 Adams John
## 1797 John Adams.11 49 66 1 1797 Adams John
## 1797 John Adams.12 34 40 1 1797 Adams John
## 1797 John Adams.13 40 56 1 1797 Adams John
## 1797 John Adams.14 25 27 1 1797 Adams John
## 1797 John Adams.15 43 58 1 1797 Adams John
## 1797 John Adams.16 38 50 1 1797 Adams John
## 1797 John Adams.17 37 58 1 1797 Adams John
## 1797 John Adams.18 16 17 1 1797 Adams John
## 1797 John Adams.19 84 123 1 1797 Adams John
## 1797 John Adams.20 18 21 1 1797 Adams John
## 1797 John Adams.21 30 35 1 1797 Adams John
## 1797 John Adams.22 10 10 1 1797 Adams John
## 1797 John Adams.23 23 28 1 1797 Adams John
## 1797 John Adams.24 26 33 1 1797 Adams John
## 1797 John Adams.25 17 17 1 1797 Adams John
## 1797 John Adams.26 26 36 1 1797 Adams John
## 1797 John Adams.27 34 46 1 1797 Adams John
## 1797 John Adams.28 36 51 1 1797 Adams John
## 1797 John Adams.29 29 45 1 1797 Adams John
## 1797 John Adams.30 37 42 1 1797 Adams John
## 1797 John Adams.31 80 128 1 1797 Adams John
## 1797 John Adams.32 41 61 1 1797 Adams John
## 1797 John Adams.33 26 28 1 1797 Adams John
## 1797 John Adams.34 22 30 1 1797 Adams John
## 1797 John Adams.35 329 808 1 1797 Adams John
## 1797 John Adams.36 51 75 1 1797 Adams John
## 1797 John Adams.37 41 58 1 1797 Adams John
## 1801 Thomas Jefferson.1 65 96 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.2 65 98 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.3 41 50 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.4 43 58 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.5 59 87 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.6 38 56 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.7 13 16 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.8 21 22 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.9 39 49 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.10 51 71 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.11 10 12 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.12 12 12 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.13 8 10 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.14 42 46 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.15 56 77 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.17 11 14 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.18 29 40 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.19 16 16 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.20 12 13 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.21 14 14 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.23 20 25 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.24 104 178 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.25 42 54 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.26 17 20 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.27 36 46 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.28 20 23 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.29 146 271 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.30 22 23 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.31 15 17 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.32 45 66 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.33 13 15 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.34 39 51 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.35 50 64 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.36 10 10 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.37 23 23 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.38 34 38 1 1801 Jefferson Thomas6.4.3.2 Paragraphs
6.4.3.2.1 Transform
## Corpus consisting of 45 documents and 3 docvars.
## 1789 George Washington.1 :
## "Fellow-Citizens of the Senate and of the House of Representa..."
##
## 1789 George Washington.2 :
## "Among the vicissitudes incident to life no event could have ..."
##
## 1789 George Washington.3 :
## "Such being the impressions under which I have, in obedience ..."
##
## 1789 George Washington.4 :
## "By the article establishing the executive department it is m..."
##
## 1789 George Washington.5 :
## "Besides the ordinary objects submitted to your care, it will..."
##
## 1789 George Washington.6 :
## "To the foregoing observations I have one to add, which will ..."
##
## [ reached max_ndoc ... 39 more documents ]6.4.3.2.2 Summary
## Corpus consisting of 45 documents, showing 45 documents:
##
## Text Types Tokens Sentences Year President FirstName
## 1789 George Washington.1 8 11 1 1789 Washington George
## 1789 George Washington.2 184 342 5 1789 Washington George
## 1789 George Washington.3 192 328 6 1789 Washington George
## 1789 George Washington.4 214 391 5 1789 Washington George
## 1789 George Washington.5 120 182 2 1789 Washington George
## 1789 George Washington.6 102 164 4 1789 Washington George
## 1789 George Washington.7 88 120 1 1789 Washington George
## 1793 George Washington.1 47 64 2 1793 Washington George
## 1793 George Washington.2 61 83 2 1793 Washington George
## 1797 John Adams.1 114 180 2 1797 Adams John
## 1797 John Adams.2 88 137 3 1797 Adams John
## 1797 John Adams.3 63 102 1 1797 Adams John
## 1797 John Adams.4 60 82 3 1797 Adams John
## 1797 John Adams.5 145 277 6 1797 Adams John
## 1797 John Adams.6 62 108 2 1797 Adams John
## 1797 John Adams.7 16 17 1 1797 Adams John
## 1797 John Adams.8 158 303 8 1797 Adams John
## 1797 John Adams.9 97 184 4 1797 Adams John
## 1797 John Adams.10 80 128 1 1797 Adams John
## 1797 John Adams.11 74 119 3 1797 Adams John
## 1797 John Adams.12 329 808 1 1797 Adams John
## 1797 John Adams.13 51 75 1 1797 Adams John
## 1797 John Adams.14 41 58 1 1797 Adams John
## 1801 Thomas Jefferson.1 5 5 1 1801 Jefferson Thomas
## 1801 Thomas Jefferson.2 166 297 4 1801 Jefferson Thomas
## 1801 Thomas Jefferson.3 268 565 18 1801 Jefferson Thomas
## 1801 Thomas Jefferson.4 145 277 4 1801 Jefferson Thomas
## 1801 Thomas Jefferson.5 226 446 6 1801 Jefferson Thomas
## 1801 Thomas Jefferson.6 143 264 7 1801 Jefferson Thomas
## 1801 Thomas Jefferson.7 56 73 2 1801 Jefferson Thomas
## 1805 Thomas Jefferson.1 50 67 1 1805 Jefferson Thomas
## 1805 Thomas Jefferson.2 42 55 2 1805 Jefferson Thomas
## 1805 Thomas Jefferson.3 80 118 3 1805 Jefferson Thomas
## 1805 Thomas Jefferson.4 94 128 4 1805 Jefferson Thomas
## 1805 Thomas Jefferson.5 153 283 4 1805 Jefferson Thomas
## 1805 Thomas Jefferson.6 107 160 5 1805 Jefferson Thomas
## 1805 Thomas Jefferson.7 49 70 2 1805 Jefferson Thomas
## 1805 Thomas Jefferson.8 121 194 3 1805 Jefferson Thomas
## 1805 Thomas Jefferson.9 130 229 2 1805 Jefferson Thomas
## 1805 Thomas Jefferson.10 80 137 4 1805 Jefferson Thomas
## 1805 Thomas Jefferson.11 80 122 3 1805 Jefferson Thomas
## 1805 Thomas Jefferson.12 111 166 2 1805 Jefferson Thomas
## 1805 Thomas Jefferson.13 97 147 2 1805 Jefferson Thomas
## 1805 Thomas Jefferson.14 148 267 4 1805 Jefferson Thomas
## 1805 Thomas Jefferson.15 132 238 4 1805 Jefferson Thomas6.4.3.2.3 Subset
We can subset sentences with 10 or more words
dat_inaug_corpus_para_long <- corpus_subset(dat_inaug_corpus_para, ntoken(dat_inaug_corpus_para) >= 10)
ndoc(dat_inaug_corpus_para_long)## [1] 44## Corpus consisting of 44 documents, showing 44 documents:
##
## Text Types Tokens Sentences Year President FirstName
## 1789 George Washington.1 8 11 1 1789 Washington George
## 1789 George Washington.2 184 342 5 1789 Washington George
## 1789 George Washington.3 192 328 6 1789 Washington George
## 1789 George Washington.4 214 391 5 1789 Washington George
## 1789 George Washington.5 120 182 2 1789 Washington George
## 1789 George Washington.6 102 164 4 1789 Washington George
## 1789 George Washington.7 88 120 1 1789 Washington George
## 1793 George Washington.1 47 64 2 1793 Washington George
## 1793 George Washington.2 61 83 2 1793 Washington George
## 1797 John Adams.1 114 180 2 1797 Adams John
## 1797 John Adams.2 88 137 3 1797 Adams John
## 1797 John Adams.3 63 102 1 1797 Adams John
## 1797 John Adams.4 60 82 3 1797 Adams John
## 1797 John Adams.5 145 277 6 1797 Adams John
## 1797 John Adams.6 62 108 2 1797 Adams John
## 1797 John Adams.7 16 17 1 1797 Adams John
## 1797 John Adams.8 158 303 8 1797 Adams John
## 1797 John Adams.9 97 184 4 1797 Adams John
## 1797 John Adams.10 80 128 1 1797 Adams John
## 1797 John Adams.11 74 119 3 1797 Adams John
## 1797 John Adams.12 329 808 1 1797 Adams John
## 1797 John Adams.13 51 75 1 1797 Adams John
## 1797 John Adams.14 41 58 1 1797 Adams John
## 1801 Thomas Jefferson.2 166 297 4 1801 Jefferson Thomas
## 1801 Thomas Jefferson.3 268 565 18 1801 Jefferson Thomas
## 1801 Thomas Jefferson.4 145 277 4 1801 Jefferson Thomas
## 1801 Thomas Jefferson.5 226 446 6 1801 Jefferson Thomas
## 1801 Thomas Jefferson.6 143 264 7 1801 Jefferson Thomas
## 1801 Thomas Jefferson.7 56 73 2 1801 Jefferson Thomas
## 1805 Thomas Jefferson.1 50 67 1 1805 Jefferson Thomas
## 1805 Thomas Jefferson.2 42 55 2 1805 Jefferson Thomas
## 1805 Thomas Jefferson.3 80 118 3 1805 Jefferson Thomas
## 1805 Thomas Jefferson.4 94 128 4 1805 Jefferson Thomas
## 1805 Thomas Jefferson.5 153 283 4 1805 Jefferson Thomas
## 1805 Thomas Jefferson.6 107 160 5 1805 Jefferson Thomas
## 1805 Thomas Jefferson.7 49 70 2 1805 Jefferson Thomas
## 1805 Thomas Jefferson.8 121 194 3 1805 Jefferson Thomas
## 1805 Thomas Jefferson.9 130 229 2 1805 Jefferson Thomas
## 1805 Thomas Jefferson.10 80 137 4 1805 Jefferson Thomas
## 1805 Thomas Jefferson.11 80 122 3 1805 Jefferson Thomas
## 1805 Thomas Jefferson.12 111 166 2 1805 Jefferson Thomas
## 1805 Thomas Jefferson.13 97 147 2 1805 Jefferson Thomas
## 1805 Thomas Jefferson.14 148 267 4 1805 Jefferson Thomas
## 1805 Thomas Jefferson.15 132 238 4 1805 Jefferson Thomas6.4.3.3 Tokens
tokens() segments texts in a corpus into tokens (words or sentences) by word boundaries. We can remove punctuations or not
6.4.3.3.1 With punctuations
## Tokens consisting of 5 documents and 3 docvars.
## 1789 George Washington :
## [1] "Fellow-Citizens" "of" "the" "Senate"
## [5] "and" "of" "the" "House"
## [9] "of" "Representatives" ":" "Among"
## [ ... and 1,526 more ]
##
## 1793 George Washington :
## [1] "Fellow" "citizens" "," "I" "am" "again"
## [7] "called" "upon" "by" "the" "voice" "of"
## [ ... and 135 more ]
##
## 1797 John Adams :
## [1] "When" "it" "was" "first" "perceived" ","
## [7] "in" "early" "times" "," "that" "no"
## [ ... and 2,566 more ]
##
## 1801 Thomas Jefferson :
## [1] "Friends" "and" "Fellow" "Citizens" ":" "Called"
## [7] "upon" "to" "undertake" "the" "duties" "of"
## [ ... and 1,915 more ]
##
## 1805 Thomas Jefferson :
## [1] "Proceeding" "," "fellow" "citizens"
## [5] "," "to" "that" "qualification"
## [9] "which" "the" "Constitution" "requires"
## [ ... and 2,369 more ]6.4.3.3.2 Without punctuations
dat_inaug_corpus_tok_no_punct <- tokens(dat_inaug_corpus, remove_punct = TRUE)
dat_inaug_corpus_tok_no_punct## Tokens consisting of 5 documents and 3 docvars.
## 1789 George Washington :
## [1] "Fellow-Citizens" "of" "the" "Senate"
## [5] "and" "of" "the" "House"
## [9] "of" "Representatives" "Among" "the"
## [ ... and 1,418 more ]
##
## 1793 George Washington :
## [1] "Fellow" "citizens" "I" "am" "again" "called"
## [7] "upon" "by" "the" "voice" "of" "my"
## [ ... and 123 more ]
##
## 1797 John Adams :
## [1] "When" "it" "was" "first" "perceived" "in"
## [7] "early" "times" "that" "no" "middle" "course"
## [ ... and 2,306 more ]
##
## 1801 Thomas Jefferson :
## [1] "Friends" "and" "Fellow" "Citizens" "Called" "upon"
## [7] "to" "undertake" "the" "duties" "of" "the"
## [ ... and 1,714 more ]
##
## 1805 Thomas Jefferson :
## [1] "Proceeding" "fellow" "citizens" "to"
## [5] "that" "qualification" "which" "the"
## [9] "Constitution" "requires" "before" "my"
## [ ... and 2,154 more ]6.4.3.4 Types
We can also generate types on the tokenised corpus (without punctuations)
dat_inaug_corpus_tok_no_punct_types <- types(dat_inaug_corpus_tok_no_punct)
dat_inaug_corpus_tok_no_punct_types## [1] "Fellow-Citizens" "of" "the"
## [4] "Senate" "and" "House"
## [7] "Representatives" "Among" "vicissitudes"
## [10] "incident" "to" "life"
## [13] "no" "event" "could"
## [16] "have" "filled" "me"
## [19] "with" "greater" "anxieties"
## [22] "than" "that" "which"
## [25] "notification" "was" "transmitted"
## [28] "by" "your" "order"
## [31] "received" "on" "14th"
## [34] "day" "present" "month"
## [37] "On" "one" "hand"
## [40] "I" "summoned" "my"
## [43] "Country" "whose" "voice"
## [46] "can" "never" "hear"
## [49] "but" "veneration" "love"
## [52] "from" "a" "retreat"
## [55] "had" "chosen" "fondest"
## [58] "predilection" "in" "flattering"
## [61] "hopes" "an" "immutable"
## [64] "decision" "as" "asylum"
## [67] "declining" "years" "rendered"
## [70] "every" "more" "necessary"
## [73] "well" "dear" "addition"
## [76] "habit" "inclination" "frequent"
## [79] "interruptions" "health" "gradual"
## [82] "waste" "committed" "it"
## [85] "time" "other" "magnitude"
## [88] "difficulty" "trust" "country"
## [91] "called" "being" "sufficient"
## [94] "awaken" "wisest" "most"
## [97] "experienced" "her" "citizens"
## [100] "distrustful" "scrutiny" "into"
## [103] "his" "qualifications" "not"
## [106] "overwhelm" "despondence" "who"
## [109] "inheriting" "inferior" "endowments"
## [112] "nature" "unpracticed" "duties"
## [115] "civil" "administration" "ought"
## [118] "be" "peculiarly" "conscious"
## [121] "own" "deficiencies" "In"
## [124] "this" "conflict" "emotions"
## [127] "all" "dare" "aver"
## [130] "is" "has" "been"
## [133] "faithful" "study" "collect"
## [136] "duty" "just" "appreciation"
## [139] "circumstance" "might" "affected"
## [142] "All" "hope" "if"
## [145] "executing" "task" "too"
## [148] "much" "swayed" "grateful"
## [151] "remembrance" "former" "instances"
## [154] "or" "affectionate" "sensibility"
## [157] "transcendent" "proof" "confidence"
## [160] "fellow" "thence" "little"
## [163] "consulted" "incapacity" "disinclination"
## [166] "for" "weighty" "untried"
## [169] "cares" "before" "error"
## [172] "will" "palliated" "motives"
## [175] "mislead" "its" "consequences"
## [178] "judged" "some" "share"
## [181] "partiality" "they" "originated"
## [184] "Such" "impressions" "under"
## [187] "obedience" "public" "summons"
## [190] "repaired" "station" "would"
## [193] "improper" "omit" "first"
## [196] "official" "act" "fervent"
## [199] "supplications" "Almighty" "Being"
## [202] "rules" "over" "universe"
## [205] "presides" "councils" "nations"
## [208] "providential" "aids" "supply"
## [211] "human" "defect" "His"
## [214] "benediction" "may" "consecrate"
## [217] "liberties" "happiness" "people"
## [220] "United" "States" "Government"
## [223] "instituted" "themselves" "these"
## [226] "essential" "purposes" "enable"
## [229] "instrument" "employed" "execute"
## [232] "success" "functions" "allotted"
## [235] "charge" "tendering" "homage"
## [238] "Great" "Author" "private"
## [241] "good" "assure" "myself"
## [244] "expresses" "sentiments" "less"
## [247] "nor" "those" "at"
## [250] "large" "either" "No"
## [253] "bound" "acknowledge" "adore"
## [256] "Invisible" "Hand" "conducts"
## [259] "affairs" "men" "Every"
## [262] "step" "advanced" "character"
## [265] "independent" "nation" "seems"
## [268] "distinguished" "token" "agency"
## [271] "important" "revolution" "accomplished"
## [274] "system" "their" "united"
## [277] "government" "tranquil" "deliberations"
## [280] "voluntary" "consent" "so"
## [283] "many" "distinct" "communities"
## [286] "resulted" "compared" "means"
## [289] "governments" "established" "without"
## [292] "return" "pious" "gratitude"
## [295] "along" "humble" "anticipation"
## [298] "future" "blessings" "past"
## [301] "seem" "presage" "These"
## [304] "reflections" "arising" "out"
## [307] "crisis" "forced" "strongly"
## [310] "mind" "suppressed" "You"
## [313] "join" "thinking" "there"
## [316] "are" "none" "influence"
## [319] "proceedings" "new" "free"
## [322] "auspiciously" "commence" "By"
## [325] "article" "establishing" "executive"
## [328] "department" "made" "President"
## [331] "recommend" "consideration" "such"
## [334] "measures" "he" "shall"
## [337] "judge" "expedient" "The"
## [340] "circumstances" "now" "meet"
## [343] "you" "acquit" "entering"
## [346] "subject" "further" "refer"
## [349] "great" "constitutional" "charter"
## [352] "assembled" "defining" "powers"
## [355] "designates" "objects" "attention"
## [358] "given" "It" "consistent"
## [361] "far" "congenial" "feelings"
## [364] "actuate" "substitute" "place"
## [367] "recommendation" "particular" "tribute"
## [370] "due" "talents" "rectitude"
## [373] "patriotism" "adorn" "characters"
## [376] "selected" "devise" "adopt"
## [379] "them" "honorable" "behold"
## [382] "surest" "pledges" "side"
## [385] "local" "prejudices" "attachments"
## [388] "separate" "views" "party"
## [391] "animosities" "misdirect" "comprehensive"
## [394] "equal" "eye" "watch"
## [397] "assemblage" "interests" "another"
## [400] "foundation" "our" "national"
## [403] "policy" "laid" "pure"
## [406] "principles" "morality" "preeminence"
## [409] "exemplified" "attributes" "win"
## [412] "affections" "command" "respect"
## [415] "world" "dwell" "prospect"
## [418] "satisfaction" "ardent" "inspire"
## [421] "since" "truth" "thoroughly"
## [424] "exists" "economy" "course"
## [427] "indissoluble" "union" "between"
## [430] "virtue" "advantage" "genuine"
## [433] "maxims" "honest" "magnanimous"
## [436] "solid" "rewards" "prosperity"
## [439] "felicity" "we" "persuaded"
## [442] "propitious" "smiles" "Heaven"
## [445] "expected" "disregards" "eternal"
## [448] "right" "itself" "ordained"
## [451] "preservation" "sacred" "fire"
## [454] "liberty" "destiny" "republican"
## [457] "model" "justly" "considered"
## [460] "perhaps" "deeply" "finally"
## [463] "staked" "experiment" "entrusted"
## [466] "hands" "American" "Besides"
## [469] "ordinary" "submitted" "care"
## [472] "remain" "judgment" "decide"
## [475] "how" "exercise" "occasional"
## [478] "power" "delegated" "fifth"
## [481] "Constitution" "juncture" "objections"
## [484] "urged" "against" "degree"
## [487] "inquietude" "birth" "Instead"
## [490] "undertaking" "recommendations" "guided"
## [493] "lights" "derived" "opportunities"
## [496] "again" "give" "way"
## [499] "entire" "discernment" "pursuit"
## [502] "whilst" "carefully" "avoid"
## [505] "alteration" "endanger" "benefits"
## [508] "effective" "await" "lessons"
## [511] "experience" "reverence" "characteristic"
## [514] "rights" "freemen" "regard"
## [517] "harmony" "sufficiently" "question"
## [520] "impregnably" "fortified" "latter"
## [523] "safely" "advantageously" "promoted"
## [526] "To" "foregoing" "observations"
## [529] "add" "properly" "addressed"
## [532] "concerns" "therefore" "brief"
## [535] "possible" "When" "honored"
## [538] "call" "service" "then"
## [541] "eve" "arduous" "struggle"
## [544] "light" "contemplated" "required"
## [547] "should" "renounce" "pecuniary"
## [550] "compensation" "From" "resolution"
## [553] "instance" "departed" "still"
## [556] "produced" "must" "decline"
## [559] "inapplicable" "any" "personal"
## [562] "emoluments" "indispensably" "included"
## [565] "permanent" "provision" "accordingly"
## [568] "pray" "estimates" "am"
## [571] "placed" "during" "continuance"
## [574] "limited" "actual" "expenditures"
## [577] "thought" "require" "Having"
## [580] "thus" "imparted" "awakened"
## [583] "occasion" "brings" "us"
## [586] "together" "take" "leave"
## [589] "resorting" "once" "benign"
## [592] "Parent" "Human" "Race"
## [595] "supplication" "He" "pleased"
## [598] "favor" "deliberating" "perfect"
## [601] "tranquillity" "dispositions" "deciding"
## [604] "unparalleled" "unanimity" "form"
## [607] "security" "advancement" "divine"
## [610] "blessing" "equally" "conspicuous"
## [613] "enlarged" "temperate" "consultations"
## [616] "wise" "depend" "Fellow"
## [619] "upon" "Chief" "Magistrate"
## [622] "proper" "arrive" "endeavor"
## [625] "express" "high" "sense"
## [628] "entertain" "honor" "reposed"
## [631] "America" "Previous" "execution"
## [634] "requires" "oath" "office"
## [637] "This" "about" "presence"
## [640] "That" "found" "violated"
## [643] "willingly" "knowingly" "injunctions"
## [646] "thereof" "besides" "incurring"
## [649] "punishment" "upbraidings" "witnesses"
## [652] "solemn" "ceremony" "perceived"
## [655] "early" "times" "middle"
## [658] "remained" "unlimited" "submission"
## [661] "foreign" "legislature" "total"
## [664] "independence" "claims" "reflection"
## [667] "were" "apprehensive" "danger"
## [670] "formidable" "fleets" "armies"
## [673] "determine" "resist" "contests"
## [676] "dissensions" "certainly" "arise"
## [679] "concerning" "forms" "whole"
## [682] "parts" "extensive" "Relying"
## [685] "however" "purity" "intentions"
## [688] "justice" "cause" "integrity"
## [691] "intelligence" "overruling" "Providence"
## [694] "signally" "protected" "representatives"
## [697] "consisting" "half" "number"
## [700] "only" "broke" "pieces"
## [703] "chains" "forging" "rod"
## [706] "iron" "lifted" "up"
## [709] "frankly" "cut" "asunder"
## [712] "ties" "launched" "ocean"
## [715] "uncertainty" "zeal" "ardor"
## [718] "Revolutionary" "war" "supplying"
## [721] "commanded" "least" "temporary"
## [724] "society" "Confederation" "felt"
## [727] "prepared" "models" "Batavian"
## [730] "Helvetic" "confederacies" "examples"
## [733] "detail" "precision" "history"
## [736] "ones" "ever" "But"
## [739] "reflecting" "striking" "difference"
## [742] "particulars" "where" "courier"
## [745] "go" "seat" "frontier"
## [748] "single" "foreseen" "assisted"
## [751] "Congress" "formation" "durable"
## [754] "Negligence" "regulations" "inattention"
## [757] "disobedience" "authority" "individuals"
## [760] "soon" "appeared" "melancholy"
## [763] "universal" "languor" "jealousies"
## [766] "rivalries" "navigation" "commerce"
## [769] "discouragement" "manufactures" "fall"
## [772] "value" "lands" "produce"
## [775] "contempt" "faith" "loss"
## [778] "credit" "length" "discontents"
## [781] "combinations" "partial" "conventions"
## [784] "insurrection" "threatening" "calamity"
## [787] "dangerous" "abandoned" "usual"
## [790] "Measures" "pursued" "concert"
## [793] "plan" "establish" "insure"
## [796] "domestic" "provide" "common"
## [799] "defense" "promote" "general"
## [802] "welfare" "secure" "disquisitions"
## [805] "discussions" "issued" "happy"
## [808] "Employed" "abroad" "transactions"
## [811] "saw" "Irritated" "literary"
## [814] "altercation" "animated" "debate"
## [817] "heated" "animosity" "read"
## [820] "result" "heads" "prompted"
## [823] "hearts" "better" "adapted"
## [826] "genius" "situation" "relations"
## [829] "proposed" "suggested" "outlines"
## [832] "conformable" "esteemed" "native"
## [835] "State" "contributed" "Claiming"
## [838] "suffrage" "fellow-citizens" "adoption"
## [841] "rejection" "constitution" "rule"
## [844] "posterity" "theirs" "did"
## [847] "hesitate" "approbation" "occasions"
## [850] "objection" "Executive" "Nor"
## [853] "entertained" "promoting" "see"
## [856] "feel" "legislatures" "according"
## [859] "ordain" "Returning" "bosom"
## [862] "after" "painful" "separation"
## [865] "ten" "elected" "things"
## [868] "repeatedly" "serious" "obligations"
## [871] "support" "operation" "equaled"
## [874] "sanguine" "expectations" "friends"
## [877] "habitual" "delight" "effects"
## [880] "peace" "acquired" "attachment"
## [883] "What" "indeed" "deserve"
## [886] "esteem" "There" "solidity"
## [889] "ancient" "idea" "congregations"
## [892] "cities" "pleasing" "sight"
## [895] "superior" "intelligences" "very"
## [898] "certain" "benevolent" "spectacle"
## [901] "presented" "noble" "majestic"
## [904] "august" "assembly" "like"
## [907] "often" "seen" "Chamber"
## [910] "branches" "Legislature" "exercised"
## [913] "regular" "periods" "neighbors"
## [916] "make" "laws" "Can"
## [919] "anything" "mere" "ornament"
## [922] "decoration" "added" "robes"
## [925] "diamonds" "amiable" "respectable"
## [928] "when" "descends" "accidents"
## [931] "institutions" "remote" "antiquity"
## [934] "springs" "fresh" "judgments"
## [937] "enlightened" "For" "represented"
## [940] "majesty" "reflected" "legitimate"
## [943] "whatever" "appear" "existence"
## [946] "ours" "full" "dissemination"
## [949] "knowledge" "throughout" "body"
## [952] "And" "what" "object"
## [955] "If" "pride" "justifiable"
## [958] "excusable" "riches" "grandeur"
## [961] "glory" "conviction" "innocence"
## [964] "information" "benevolence" "midst"
## [967] "ideas" "unfaithful" "ourselves"
## [970] "lose" "extraneous" "infect"
## [973] "fair" "virtuous" "elections"
## [976] "election" "determined" "majority"
## [979] "vote" "procured" "through"
## [982] "artifice" "corruption" "choice"
## [985] "ends" "solitary" "obtained"
## [988] "flattery" "menaces" "fraud"
## [991] "violence" "terror" "intrigue"
## [994] "venality" "govern" "candid"
## [997] "cases" "boast" "lot"
## [1000] "chance" "interesting" "abuses"
## [1003] "exposed" "exhibited" "admiration"
## [1006] "anxiety" "eight" "citizen"
## [1009] "long" "actions" "regulated"
## [1012] "prudence" "temperance" "fortitude"
## [1015] "conducting" "inspired" "same"
## [1018] "virtues" "increasing" "wealth"
## [1021] "unexampled" "merited" "highest"
## [1024] "praises" "secured" "immortal"
## [1027] "retirement" "live" "enjoy"
## [1030] "delicious" "recollection" "services"
## [1033] "mankind" "fruits" "himself"
## [1036] "daily" "splendid" "fortunes"
## [1039] "opening" "year" "name"
## [1042] "rampart" "lives" "bulwark"
## [1045] "open" "secret" "enemies"
## [1048] "country's" "example" "recommended"
## [1051] "imitation" "successors" "both"
## [1054] "Houses" "become" "silent"
## [1057] "speak" "diffidence" "something"
## [1060] "admitted" "apology" "venture"
## [1063] "say" "preference" "principle"
## [1066] "formed" "diligent" "impartial"
## [1069] "inquiry" "conscientious" "determination"
## [1072] "until" "altered" "wishes"
## [1075] "expressed" "mode" "prescribed"
## [1078] "respectful" "constitutions" "individual"
## [1081] "constant" "caution" "delicacy"
## [1084] "toward" "interest" "Union"
## [1087] "northern" "southern" "eastern"
## [1090] "western" "position" "various"
## [1093] "political" "opinions" "unessential"
## [1096] "points" "parties" "denominations"
## [1099] "science" "letters" "wish"
## [1102] "patronize" "rational" "effort"
## [1105] "encourage" "schools" "colleges"
## [1108] "universities" "academies" "institution"
## [1111] "propagating" "religion" "among"
## [1114] "classes" "stages" "preserving"
## [1117] "natural" "spirit" "sophistry"
## [1120] "profligacy" "pestilence" "angel"
## [1123] "destruction" "elective" "humanity"
## [1126] "interior" "improve" "agriculture"
## [1129] "manufacturers" "necessity" "convenience"
## [1132] "equity" "aboriginal" "disposition"
## [1135] "meliorate" "condition" "inclining"
## [1138] "friendly" "inflexible" "maintain"
## [1141] "inviolable" "neutrality" "impartiality"
## [1144] "belligerent" "Europe" "adopted"
## [1147] "solemnly" "sanctioned" "applauded"
## [1150] "opinion" "otherwise" "French"
## [1153] "residence" "seven" "chiefly"
## [1156] "sincere" "desire" "preserve"
## [1159] "friendship" "while" "internal"
## [1162] "sentiment" "energies" "preserved"
## [1165] "earnest" "investigate" "remove"
## [1168] "colorable" "pretense" "complaint"
## [1171] "intention" "pursue" "amicable"
## [1174] "negotiation" "reparation" "injuries"
## [1177] "lay" "facts" "consider"
## [1180] "constituents" "demand" "do"
## [1183] "unshaken" "resources" "hazarded"
## [1186] "deceived" "elevated" "destinies"
## [1189] "founded" "moral" "intellectual"
## [1192] "improvements" "engraven" "obscured"
## [1195] "exalted" "age" "profess"
## [1198] "Christians" "fixed" "decent"
## [1201] "Christianity" "best" "comply"
## [1204] "strenuous" "sagacious" "injunction"
## [1207] "two" "effect" "With"
## [1210] "pledged" "doubt" "energy"
## [1213] "hesitation" "utmost" "supreme"
## [1216] "Patron" "Order" "Fountain"
## [1219] "Justice" "Protector" "ages"
## [1222] "continue" "duration" "providence"
## [1225] "Friends" "Citizens" "Called"
## [1228] "undertake" "avail" "portion"
## [1231] "here" "thanks" "look"
## [1234] "declare" "consciousness" "above"
## [1237] "approach" "anxious" "awful"
## [1240] "presentiments" "greatness" "weakness"
## [1243] "A" "rising" "spread"
## [1246] "wide" "fruitful" "land"
## [1249] "traversing" "seas" "rich"
## [1252] "productions" "industry" "engaged"
## [1255] "forget" "advancing" "rapidly"
## [1258] "beyond" "reach" "mortal"
## [1261] "contemplate" "beloved" "issue"
## [1264] "auspices" "shrink" "contemplation"
## [1267] "Utterly" "despair" "whom"
## [1270] "remind" "authorities" "provided"
## [1273] "find" "wisdom" "rely"
## [1276] "difficulties" "gentlemen" "charged"
## [1279] "sovereign" "legislation" "associated"
## [1282] "encouragement" "guidance" "steer"
## [1285] "safety" "vessel" "embarked"
## [1288] "amidst" "conflicting" "elements"
## [1291] "troubled" "During" "contest"
## [1294] "passed" "animation" "exertions"
## [1297] "sometimes" "worn" "aspect"
## [1300] "impose" "strangers" "unused"
## [1303] "think" "freely" "write"
## [1306] "decided" "announced" "arrange"
## [1309] "law" "unite" "efforts"
## [1312] "bear" "though" "prevail"
## [1315] "rightful" "reasonable" "minority"
## [1318] "possess" "protect" "violate"
## [1321] "oppression" "Let" "heart"
## [1324] "restore" "social" "intercourse"
## [1327] "affection" "even" "dreary"
## [1330] "let" "reflect" "having"
## [1333] "banished" "religious" "intolerance"
## [1336] "bled" "suffered" "yet"
## [1339] "gained" "countenance" "despotic"
## [1342] "wicked" "capable" "bitter"
## [1345] "bloody" "persecutions" "throes"
## [1348] "convulsions" "agonizing" "spasms"
## [1351] "infuriated" "man" "seeking"
## [1354] "blood" "slaughter" "long-lost"
## [1357] "wonderful" "agitation" "billows"
## [1360] "distant" "peaceful" "shore"
## [1363] "feared" "others" "divide"
## [1366] "We" "different" "names"
## [1369] "brethren" "Republicans" "Federalists"
## [1372] "dissolve" "change" "stand"
## [1375] "undisturbed" "monuments" "tolerated"
## [1378] "reason" "left" "combat"
## [1381] "know" "fear" "strong"
## [1384] "enough" "patriot" "tide"
## [1387] "successful" "abandon" "kept"
## [1390] "firm" "theoretic" "visionary"
## [1393] "world's" "possibility" "want"
## [1396] "believe" "contrary" "strongest"
## [1399] "earth" "fly" "standard"
## [1402] "invasions" "concern" "Sometimes"
## [1405] "said" "trusted" "Or"
## [1408] "angels" "kings" "him"
## [1411] "answer" "courage" "Federal"
## [1414] "Republican" "representative" "Kindly"
## [1417] "separated" "exterminating" "havoc"
## [1420] "quarter" "globe" "high-minded"
## [1423] "endure" "degradations" "possessing"
## [1426] "room" "descendants" "thousandth"
## [1429] "generation" "entertaining" "use"
## [1432] "faculties" "acquisitions" "resulting"
## [1435] "professed" "practiced" "inculcating"
## [1438] "honesty" "acknowledging" "adoring"
## [1441] "dispensations" "proves" "delights"
## [1444] "hereafter" "prosperous" "Still"
## [1447] "thing" "frugal" "restrain"
## [1450] "injuring" "regulate" "pursuits"
## [1453] "improvement" "mouth" "labor"
## [1456] "bread" "earned" "sum"
## [1459] "close" "circle" "felicities"
## [1462] "About" "enter" "comprehend"
## [1465] "everything" "valuable" "understand"
## [1468] "deem" "consequently" "shape"
## [1471] "Administration" "compress" "within"
## [1474] "narrowest" "compass" "stating"
## [1477] "limitations" "Equal" "exact"
## [1480] "state" "persuasion" "entangling"
## [1483] "alliances" "competent" "administrations"
## [1486] "bulwarks" "antirepublican" "tendencies"
## [1489] "General" "vigor" "sheet"
## [1492] "anchor" "home" "jealous"
## [1495] "mild" "safe" "corrective"
## [1498] "lopped" "sword" "peaceable"
## [1501] "remedies" "unprovided" "absolute"
## [1504] "acquiescence" "decisions" "vital"
## [1507] "republics" "appeal" "force"
## [1510] "immediate" "parent" "despotism"
## [1513] "disciplined" "militia" "reliance"
## [1516] "moments" "till" "regulars"
## [1519] "relieve" "supremacy" "military"
## [1522] "expense" "lightly" "burthened"
## [1525] "payment" "debts" "handmaid"
## [1528] "diffusion" "arraignment" "bar"
## [1531] "freedom" "press" "person"
## [1534] "protection" "habeas" "corpus"
## [1537] "trial" "juries" "impartially"
## [1540] "bright" "constellation" "gone"
## [1543] "steps" "reformation" "sages"
## [1546] "heroes" "devoted" "attainment"
## [1549] "They" "creed" "text"
## [1552] "civic" "instruction" "touchstone"
## [1555] "try" "wander" "alarm"
## [1558] "hasten" "retrace" "regain"
## [1561] "road" "alone" "leads"
## [1564] "repair" "post" "assigned"
## [1567] "subordinate" "offices" "greatest"
## [1570] "learnt" "expect" "rarely"
## [1573] "imperfect" "retire" "reputation"
## [1576] "bring" "Without" "pretensions"
## [1579] "revolutionary" "preeminent" "entitled"
## [1582] "destined" "fairest" "page"
## [1585] "volume" "ask" "firmness"
## [1588] "legal" "wrong" "positions"
## [1591] "view" "ground" "indulgence"
## [1594] "errors" "intentional" "condemn"
## [1597] "implied" "consolation" "solicitude"
## [1600] "retain" "bestowed" "advance"
## [1603] "conciliate" "doing" "instrumental"
## [1606] "patronage" "work" "ready"
## [1609] "whenever" "sensible" "Infinite"
## [1612] "Power" "lead" "favorable"
## [1615] "Proceeding" "qualification" "entrance"
## [1618] "conferred" "deep" "inspires"
## [1621] "conduct" "satisfy" "taking"
## [1624] "declared" "believed" "administer"
## [1627] "Commonwealth" "MY" "conscience"
## [1630] "tells" "acted" "declaration"
## [1633] "obvious" "import" "understanding"
## [1636] "transaction" "endeavored" "cultivate"
## [1639] "especially" "done" "favored"
## [1642] "lawful" "cherished" "mutual"
## [1645] "terms" "firmly" "convinced"
## [1648] "soundly" "calculated" "inseparable"
## [1651] "bears" "witness" "fact"
## [1654] "word" "recourse" "armaments"
## [1657] "wars" "bridle" "At"
## [1660] "whether" "ill" "suppression"
## [1663] "unnecessary" "useless" "establishments"
## [1666] "expenses" "enabled" "discontinue"
## [1669] "taxes" "covering" "officers"
## [1672] "doors" "intrusions" "already"
## [1675] "begun" "process" "domiciliary"
## [1678] "vexation" "entered" "scarcely"
## [1681] "restrained" "reaching" "successively"
## [1684] "property" "minor" "fell"
## [1687] "inconvenient" "because" "amount"
## [1690] "paid" "collected" "merit"
## [1693] "instead" "approved" "remaining"
## [1696] "revenue" "consumption" "articles"
## [1699] "afford" "luxuries" "comforts"
## [1702] "seaboard" "frontiers" "incorporated"
## [1705] "mercantile" "pleasure" "farmer"
## [1708] "mechanic" "laborer" "sees"
## [1711] "taxgatherer" "contributions" "current"
## [1714] "fulfill" "contracts" "extinguish"
## [1717] "soil" "limits" "extend"
## [1720] "apply" "surplus" "places"
## [1723] "short" "final" "redemption"
## [1726] "effected" "thereby" "liberated"
## [1729] "repartition" "corresponding" "amendment"
## [1732] "applied" "rivers" "canals"
## [1735] "roads" "arts" "education"
## [1738] "each" "injustice" "increased"
## [1741] "population" "aided" "reserved"
## [1744] "encroaching" "generations" "burthening"
## [1747] "War" "suspension" "useful"
## [1750] "works" "progress" "income"
## [1753] "extension" "possibly" "pay"
## [1756] "meantime" "keep" "down"
## [1759] "accruing" "events" "replace"
## [1762] "advances" "acquisition" "Louisiana"
## [1765] "disapproved" "apprehension" "enlargement"
## [1768] "territory" "limit" "extent"
## [1771] "federative" "operate" "effectively"
## [1774] "larger" "association" "shaken"
## [1777] "passions" "opposite" "bank"
## [1780] "Mississippi" "settled" "children"
## [1783] "family" "likely" "matters"
## [1786] "undertaken" "prescribe" "exercises"
## [1789] "suited" "direction" "discipline"
## [1792] "church" "acknowledged" "several"
## [1795] "societies" "inhabitants" "countries"
## [1798] "regarded" "commiseration" "Endowed"
## [1801] "breathing" "occupying" "stream"
## [1804] "overflowing" "regions" "directed"
## [1807] "shores" "divert" "habits"
## [1810] "contend" "overwhelmed" "driven"
## [1813] "reduced" "narrow" "hunter's"
## [1816] "enjoins" "teach" "prepare"
## [1819] "bodily" "adds" "morals"
## [1822] "liberally" "furnished" "implements"
## [1825] "husbandry" "household" "instructors"
## [1828] "covered" "aegis" "aggressors"
## [1831] "endeavors" "enlighten" "fate"
## [1834] "awaits" "induce" "follow"
## [1837] "dictates" "powerful" "obstacles"
## [1840] "encounter" "combated" "bodies"
## [1843] "minds" "ignorance" "interested"
## [1846] "crafty" "nothing" "persons"
## [1849] "inculcate" "sanctimonious" "customs"
## [1852] "ancestors" "whatsoever" "false"
## [1855] "guide" "counsel" "physical"
## [1858] "perilous" "innovation" "Creator"
## [1861] "also" "action" "counteraction"
## [1864] "bigotry" "antiphilosophists" "keeping"
## [1867] "dread" "exert" "ascendancy"
## [1870] "improving" "obeying" "mandates"
## [1873] "giving" "mean" "arrogate"
## [1876] "weight" "strengthen" "sound"
## [1879] "discretion" "select" "confide"
## [1882] "legislative" "foundations" "wholesome"
## [1885] "remains" "able" "auxiliaries"
## [1888] "disturb" "artillery" "leveled"
## [1891] "licentiousness" "regretted" "inasmuch"
## [1894] "tend" "lessen" "usefulness"
## [1897] "sap" "corrected" "punishments"
## [1900] "falsehood" "defamation" "urgent"
## [1903] "servants" "offenders" "indignation"
## [1906] "uninteresting" "fairly" "fully"
## [1909] "discussion" "unaided" "propagation"
## [1912] "true" "unwilling" "written"
## [1915] "tried" "witnessed" "scene"
## [1918] "looked" "cool" "latent"
## [1921] "source" "outrages" "proceeded"
## [1924] "gathered" "around" "functionaries"
## [1927] "pronounced" "verdict" "served"
## [1930] "consolatory" "friend" "believes"
## [1933] "control" "inference" "intended"
## [1936] "defamatory" "publications" "enforced"
## [1939] "renders" "reforming" "salutary"
## [1942] "coercions" "noted" "prove"
## [1945] "maintained" "league" "confined"
## [1948] "needs" "restraint" "correct"
## [1951] "reasoning" "hearing" "definite"
## [1954] "line" "drawn" "inestimable"
## [1957] "demoralizing" "improprieties" "supplement"
## [1960] "sought" "censorship" "Contemplating"
## [1963] "manifested" "generally" "auguring"
## [1966] "offer" "congratulations" "rallied"
## [1969] "point" "gaining" "strength"
## [1972] "piercing" "veil" "doubting"
## [1975] "mass" "resolve" "honestly"
## [1978] "cultivated" "unassailed" "equality"
## [1981] "unequal" "results" "father's"
## [1984] "satisfied" "approve" "cherish"
## [1987] "patient" "competitions" "need"
## [1990] "gather" "fold" "complete"
## [1993] "gives" "benefit" "proceed"
## [1996] "astray" "passion" "seduce"
## [1999] "path" "weaknesses" "injurious"
## [2002] "heretofore" "led" "fathers"
## [2005] "Israel" "old" "planted"
## [2008] "flowing" "necessaries" "infancy"
## [2011] "riper" "goodness" "prosper"6.4.3.5 Keyword-in-contexts (kwic)
6.4.3.5.1 Pattern
You can see how keywords are used in the actual contexts in a concordance view produced by kwic(). Pattern is used to search for the pattern we are interested in (with * as a wildcard). Window used to display number of words/tokens around it.
dat_inaug_corpus_tok_no_punct_hus <- kwic(dat_inaug_corpus_tok_no_punct, pattern = "pres*", window = 6)
head(dat_inaug_corpus_tok_no_punct_hus, 10)## Keyword-in-context with 10 matches.
## [1789 George Washington, 45] on the 14th day of the |
## [1789 George Washington, 343] the public summons repaired to the |
## [1789 George Washington, 370] who rules over the universe who |
## [1789 George Washington, 583] blessings which the past seem to |
## [1789 George Washington, 590] These reflections arising out of the |
## [1789 George Washington, 647] is made the duty of the |
## [1789 George Washington, 957] itself has ordained and since the |
## [1789 George Washington, 1030] Constitution is rendered expedient at the |
## [1789 George Washington, 1342] us together I shall take my |
## [1793 George Washington, 70] of any official act of the |
##
## present | month On the one hand I
## present | station it would be peculiarly improper
## presides | in the councils of nations and
## presage | These reflections arising out of the
## present | crisis have forced themselves too strongly
## President | to recommend to your consideration such
## preservation | of the sacred fire of liberty
## present | juncture by the nature of objections
## present | leave but not without resorting once
## President | the Constitution requires an oath of6.4.3.5.2 Phrase
dat_inaug_corpus_tok_no_punct_phrase <- kwic(dat_inaug_corpus_tok_no_punct, pattern = phrase("the Constitution"), window = 6)
head(dat_inaug_corpus_tok_no_punct_phrase, 10)## Keyword-in-context with 10 matches.
## [1789 George Washington, 1023:1024]
## [1793 George Washington, 71:72]
## [1797 John Adams, 465:466]
## [1797 John Adams, 688:689]
## [1797 John Adams, 739:740]
## [1797 John Adams, 1537:1538]
## [1797 John Adams, 2225:2226]
## [1801 Thomas Jefferson, 331:332]
## [1805 Thomas Jefferson, 8:9]
## [1805 Thomas Jefferson, 482:483]
##
## delegated by the fifth article of | the Constitution |
## any official act of the President | the Constitution |
## of these transactions I first saw | the Constitution |
## and the State legislatures according to | the Constitution |
## the most serious obligations to support | the Constitution |
## after truth if an attachment to | the Constitution |
## same American people pledged to support | the Constitution |
## announced according to the rules of | the Constitution |
## fellow citizens to that qualification which | the Constitution |
## States and a corresponding amendment of | the Constitution |
##
## is rendered expedient at the present
## requires an oath of office This
## of the United States in a
## itself adopt and ordain Returning to
## The operation of it has equaled
## of the United States and a
## of the United States I entertain
## all will of course arrange themselves
## requires before my entrance on the
## be applied in time of peace6.4.3.6 stopwords
stopwords are function words (or grammatical words). We can search for these and remove them (if not necessary). This step is often useful because we are not interested in these stop_words.
tokens_remove() is an alias to tokens_select(selection = "remove")
dat_inaug_corpus_tok_no_punct_no_Stop <- tokens_select(dat_inaug_corpus_tok_no_punct, pattern = stopwords("en", source = "stopwords-iso"), selection = "remove")
dat_inaug_corpus_tok_no_punct_no_Stop## Tokens consisting of 5 documents and 3 docvars.
## 1789 George Washington :
## [1] "Fellow-Citizens" "Senate" "House" "Representatives"
## [5] "vicissitudes" "incident" "life" "event"
## [9] "filled" "anxieties" "notification" "transmitted"
## [ ... and 496 more ]
##
## 1793 George Washington :
## [1] "Fellow" "citizens" "called" "voice" "country"
## [6] "execute" "functions" "Chief" "Magistrate" "occasion"
## [11] "proper" "arrive"
## [ ... and 36 more ]
##
## 1797 John Adams :
## [1] "perceived" "times" "middle" "America" "remained"
## [6] "unlimited" "submission" "foreign" "legislature" "total"
## [11] "independence" "claims"
## [ ... and 824 more ]
##
## 1801 Thomas Jefferson :
## [1] "Friends" "Fellow" "Citizens" "Called" "undertake" "duties"
## [7] "executive" "office" "country" "avail" "presence" "portion"
## [ ... and 599 more ]
##
## 1805 Thomas Jefferson :
## [1] "Proceeding" "fellow" "citizens" "qualification"
## [5] "Constitution" "requires" "entrance" "charge"
## [9] "conferred" "duty" "express" "deep"
## [ ... and 747 more ]6.4.3.7 wordstem
To be able to extract the stems of each of the given words, we use the function tokens_wordstem, char_wordstem or dfm_wordstem
6.4.3.7.1 tokens_wordstem
dat_inaug_corpus_tok_no_punct_no_Stop_stem <- tokens_wordstem(dat_inaug_corpus_tok_no_punct_no_Stop)
dat_inaug_corpus_tok_no_punct_no_Stop_stem## Tokens consisting of 5 documents and 3 docvars.
## 1789 George Washington :
## [1] "Fellow-Citizen" "Senat" "Hous" "Repres"
## [5] "vicissitud" "incid" "life" "event"
## [9] "fill" "anxieti" "notif" "transmit"
## [ ... and 496 more ]
##
## 1793 George Washington :
## [1] "Fellow" "citizen" "call" "voic" "countri" "execut"
## [7] "function" "Chief" "Magistr" "occas" "proper" "arriv"
## [ ... and 36 more ]
##
## 1797 John Adams :
## [1] "perceiv" "time" "middl" "America" "remain"
## [6] "unlimit" "submiss" "foreign" "legislatur" "total"
## [11] "independ" "claim"
## [ ... and 824 more ]
##
## 1801 Thomas Jefferson :
## [1] "Friend" "Fellow" "Citizen" "Call" "undertak" "duti"
## [7] "execut" "offic" "countri" "avail" "presenc" "portion"
## [ ... and 599 more ]
##
## 1805 Thomas Jefferson :
## [1] "Proceed" "fellow" "citizen" "qualif" "Constitut" "requir"
## [7] "entranc" "charg" "confer" "duti" "express" "deep"
## [ ... and 747 more ]6.4.3.7.2 dfm_wordstem
Here we can use the dfm (for Document Feature Matrix) to obtain details of the wordstems used in each of the texts
dat_inaug_corpus_tok_no_punct_no_Stop_dfm <- dfm(dat_inaug_corpus_tok_no_punct_no_Stop)
dfm_wordstem(dat_inaug_corpus_tok_no_punct_no_Stop_dfm)## Document-feature matrix of: 5 documents, 1,227 features (69.80% sparse) and 3 docvars.
## features
## docs fellow-citizen senat hous repres vicissitud incid life
## 1789 George Washington 1 1 2 2 1 1 1
## 1793 George Washington 0 0 0 0 0 0 0
## 1797 John Adams 3 1 3 3 0 0 2
## 1801 Thomas Jefferson 2 0 0 1 0 0 1
## 1805 Thomas Jefferson 0 0 0 0 0 0 2
## features
## docs event fill anxieti
## 1789 George Washington 2 1 1
## 1793 George Washington 0 0 0
## 1797 John Adams 0 0 1
## 1801 Thomas Jefferson 0 0 0
## 1805 Thomas Jefferson 1 0 0
## [ reached max_nfeat ... 1,217 more features ]