tscrape

twitter scraper
git clone git://git.codemadness.org/tscrape
Log | Files | Refs | README | LICENSE

DateCommit messageAuthorFiles+-
2019-08-18 15:06bump version to 0.3Hiltjo Posthuma1+1-1
2019-08-18 12:01man pages: fix mandoc lint warnings + wording tweaksHiltjo Posthuma4+10-10
2019-08-17 10:10man page documentation for all tools: copied from sfeed and changedHiltjo Posthuma6+326-3
2019-08-02 16:46xml: improve cdata and comment callback logicHiltjo Posthuma1+2-2
2019-08-02 16:33tscrape_update: sync improvements from sfeed_updateHiltjo Posthuma2+10-10
2019-05-12 17:20tscrape_update improvementsHiltjo Posthuma1+69-35
2019-05-12 17:19README: add preface text, list dependenciesHiltjo Posthuma1+31-4
2019-05-12 17:19example: fix typo in nameHiltjo Posthuma1+1-1
2019-05-12 16:58tscrape_update: disable If-Modified-Since by defaultHiltjo Posthuma1+1-1
2019-04-23 19:07bump version to 0.2Hiltjo Posthuma1+1-1
2019-04-23 19:06Makefile: make it simpler to not compile compat objectsHiltjo Posthuma1+15-9
2019-04-23 19:06util.h: remove unused macro ISUTF8Hiltjo Posthuma1+1-2
2019-04-22 12:46README: update, add twitter to Atom exampleHiltjo Posthuma1+19-1
2019-04-22 12:46sync XML improvementsHiltjo Posthuma2+19-14
2019-02-22 12:11Makefile / make dist: there is no TODO fileHiltjo Posthuma1+1-2
2019-02-22 12:09Makefile: add DOCPREFIX for installing docs in ports, use system {C,LD}FLAGSHiltjo Posthuma2+21-16
2019-02-22 12:02xml: remove unnecesary checksHiltjo Posthuma1+16-29
2018-12-18 17:10rename getchar_ignore to getnext_ignoreHiltjo Posthuma1+3-3
2018-12-17 17:55tscrape.1: formatted timestamp field was removed a long time agoHiltjo Posthuma1+0-2
2018-12-17 17:40tscrape_update: remove unused terminated() functionHiltjo Posthuma1+0-4
2018-12-17 17:32ignore incorrect unescaped HTML in <style> or <script> in a better wayHiltjo Posthuma1+37-16
2018-12-17 17:25XML tag parse improvements for PI and end tagsHiltjo Posthuma1+29-23
2018-12-17 17:23Makefile: just use OpenBSD #ifdef for pledge(2)Hiltjo Posthuma2+1-4
2018-12-17 17:16tscrape_update: Sync with sfeed_updateLeonardo Taccari1+65-28
2018-09-07 17:36util: fix UB with ctype functionsHiltjo Posthuma1+3-3
2018-09-07 17:35fix UB with ctype functionsHiltjo Posthuma1+3-2
2018-08-26 13:24remove stdint.h header: not needed anymoreHiltjo Posthuma2+0-2
2018-08-26 13:23xml: sync many XML parser improvementsHiltjo Posthuma2+95-77
2018-05-11 18:24tscrape_plain: include sys/types.hHiltjo Posthuma1+2-0
2018-05-11 18:20update tscrape.1: document formatHiltjo Posthuma1+15-5
2018-05-11 18:20improve Makefile, install tscrape.1Hiltjo Posthuma1+5-20
2018-03-30 12:34bump LICENSEHiltjo Posthuma1+1-1
2018-03-11 23:45remove unused variableHiltjo Posthuma1+0-2
2018-03-11 17:45sync xml improvementsHiltjo Posthuma1+50-40
2017-08-26 13:36improve and simplify ignore tag handlingHiltjo Posthuma1+22-31
2017-08-26 11:43xml: simplify a bitHiltjo Posthuma1+2-3
2017-08-26 10:43simplify ignore tags parsingHiltjo Posthuma1+30-49
2017-08-25 15:51when ignoring then ignore all attribute parsing aswellHiltjo Posthuma1+4-1
2017-08-25 15:44initial support to ignore literals in <script> and <style>Hiltjo Posthuma1+61-9
2017-08-25 15:39v -> c for classname shorthandHiltjo Posthuma1+8-8
2017-08-25 15:36initial video extract supportHiltjo Posthuma1+7-0
2017-08-25 14:37fix data-image-urlHiltjo Posthuma1+3-1
2017-08-13 09:17cleanup: remove baseurl and encoding and some leftovers from sfeedHiltjo Posthuma2+3-4
2017-08-13 09:04tscrape_html: add style.cssHiltjo Posthuma1+66-0
2017-08-13 08:26add tscraperc example fileHiltjo Posthuma1+9-0
2017-08-12 15:47add tscrape_update, tscrape_html format program, update MakefileHiltjo Posthuma4+181-31
2017-08-12 15:23first version of tscrape_htmlHiltjo Posthuma2+165-0
2017-08-12 15:15parse own username and fullname from data, add item username and fullnameHiltjo Posthuma2+38-25
2017-08-12 10:52separate parsing and formatting like sfeedHiltjo Posthuma5+281-76
2017-08-12 10:51store retweet id instead of 0 or 1Hiltjo Posthuma1+5-5
2017-08-12 10:28only print tweet if it has a text and usernameHiltjo Posthuma1+2-1
2017-08-12 10:27reset classname in xmltagend is not neededHiltjo Posthuma1+0-2
2017-08-11 17:29add support of the message/status id and to see if pinned or retweetHiltjo Posthuma1+32-14
2017-08-11 17:29with_replies link is not supported anymore I thinkHiltjo Posthuma2+0-9
2017-08-11 14:15parse classname better, hide u-hidden image links, but show direct image linksHiltjo Posthuma1+16-2
2017-08-11 13:46increase buffer size, separate @username with spacesHiltjo Posthuma1+10-6
2017-08-10 16:02workaround/hack: add whitespace after links...Hiltjo Posthuma1+2-0
2017-05-13 11:49remove unused compat.hHiltjo Posthuma1+0-6
2017-05-13 11:46add example scriptHiltjo Posthuma1+15-0
2017-05-13 11:36revert d3d9b9db6743dce94cc7185abfef32dc0fd56578Hiltjo Posthuma1+1-9
2017-05-13 11:23simplify pledge(2) #ifdefHiltjo Posthuma1+4-8
2017-05-13 11:19encode HTML entities (just in case).Hiltjo Posthuma1+9-1
2016-10-08 09:12config.mk: use -D_DEFAULT_SOURCE for CPPFLAGSHiltjo Posthuma1+1-1
2016-04-23 13:06fix typo due to intense hatred of HTTP2Hiltjo Posthuma1+1-1
2016-04-23 13:03fuck HTTP2Hiltjo Posthuma2+4-4
2016-04-23 11:22slightly better privacy, hide user-agentHiltjo Posthuma2+5-5
2016-04-23 11:20fix warningHiltjo Posthuma1+1-1
2016-04-23 11:16support 64-bit time_t (if twitter still exists by then :P)Hiltjo Posthuma1+3-3
2016-04-23 11:13use localtime and shorter formatHiltjo Posthuma2+3-3
2016-04-23 11:14increase text bufferHiltjo Posthuma1+1-1
2016-04-23 11:14strip trailing, leading and repeated whitespaceHiltjo Posthuma1+9-2
2016-04-23 10:37twitter uses HTTP/2.0 now, curl needs this flag to transparently decompress GZIPped contentHiltjo Posthuma3+5-5
2016-03-10 17:58remove cast of unused variablesHiltjo Posthuma1+0-22
2016-03-10 17:53Makefile: define CPPFLAGS once, fix typoHiltjo Posthuma1+3-4
2016-03-09 21:27improve build, MakefileHiltjo Posthuma3+64-49
2016-03-08 18:14pledge() tscrapeHiltjo Posthuma1+16-0
2016-03-08 18:06improve documentation, add example to man pageHiltjo Posthuma2+13-4
2016-03-08 18:00LICENSE: change license to ISC (simpler wording)Hiltjo Posthuma2+13-19
2015-09-17 22:13xml.h: really remove stdint.h ;)Hiltjo Posthuma1+0-2
2015-09-17 22:08xml.h: dont include stdint.hHiltjo Posthuma1+1-0
2015-09-17 22:05fix build for linux without strl functionsAlexander Huemer2+3-0
2015-09-13 21:20convert some html entities aswell (&nbsp; -> " " in particular)Hiltjo Posthuma1+15-2
2015-09-12 20:11dont output timestamp if invalid numberHiltjo Posthuma1+19-13
2015-09-12 19:53output formatted timestamp aswellHiltjo Posthuma2+46-4
2015-09-12 19:17improve README and LICENSEHiltjo Posthuma2+19-4
2015-09-12 19:10replace control characters by a single spaceHiltjo Posthuma2+15-4
2015-09-12 18:59config.mk: enable optimized build by defaultHiltjo Posthuma1+6-6
2015-09-12 18:58remove unused codeHiltjo Posthuma1+0-3
2015-09-12 18:46initial repoHiltjo Posthuma11+974-0