tscrape
-------

Twitter feed parser.

It parses JSON from stdin and outputs it to a TAB-separated format that can be
processed easier with various (UNIX) tools. There are formatting programs
included to convert this TAB-separated format to various other formats. There
are also some programs and scripts included to import and export OPML and to
fetch, filter, merge and order items.

The name tscrape is used because it used to scrape the HTML from the Twitter
page.  It is now using the JSON API.


Build and install
-----------------

$ make
# make install


Usage
-----

* Create a tscraperc configuration file in ~/.tscrape/tscraperc, see tscraperc.example.
* Run tscrape_update


Using sfeed to convert the tscrape TSV output to an Atom feed:

	tscrape < ~/.tscrape/feeds/name | \
	awk 'BEGIN { OFS = FS = "\t"; }
	{
		print $1 OFS $4 OFS "https://twitter.com/" $6 "/status/" $5  \
			OFS "" OFS "" OFS $5 OFS $7 OFS "";
	}' | sfeed_atom

sfeed can be found at: https://codemadness.org/git/sfeed/file/README.html


Why
---

Twitter removed the functionality to follow users using a RSS feed without
authenticating or using their API. With this program you can format tweets in
any way you like relatively anonymously.


Dependencies
------------

- C compiler (C99).
- libc (recommended: C99 and POSIX >= 200809).


Optional dependencies
---------------------

- POSIX make(1) for Makefile.
- POSIX sh(1),
  used by tscrape_update(1).
- curl(1) binary: https://curl.haxx.se/ ,
  used by tscrape_update(1), can be replaced with any tool like wget(1),
  OpenBSD ftp(1) or hurl(1): https://git.codemadness.org/hurl/
- mandoc for documentation: https://mdocml.bsd.lv/


License
-------

ISC, see LICENSE file.


Author
------

Hiltjo Posthuma <hiltjo@codemadness.org>
