sheet.git
2 years agotools: preserve make errors, ignore empty output
Mischa POSLAWSKY [Sun, 4 Jun 2017 21:54:51 +0000 (23:54 +0200)]
tools: preserve make errors, ignore empty output

Exit codes lost since commit v1.9-305-ga7e3d17ab8 (2017-05-29)
[tools: atomic creation of include files].  Fixed using `mispipe`
also provided by moreutils.  As additional fail-safe, also catch
empty results with `ifne` to keep existing data on failure.

2 years agotools: output git action during make
Mischa POSLAWSKY [Sun, 4 Jun 2017 21:53:35 +0000 (23:53 +0200)]
tools: output git action during make

Either clone or pull with matching echo, quiet execution.

2 years agotools: make functions for common file creation
Mischa POSLAWSKY [Sun, 4 Jun 2017 21:53:35 +0000 (23:53 +0200)]
tools: make functions for common file creation

Identical results.

2 years agocommon: drop compatibility copyright rel
Mischa POSLAWSKY [Tue, 30 May 2017 02:27:46 +0000 (04:27 +0200)]
common: drop compatibility copyright rel

Alternate value as supported by old Presto browsers, apparently deprecated
in current standards according to <https://validator.w3.org/>:

> The keyword copyright for the rel attribute should not be used.
> Consider using license instead.

Nobody cares about (or uses) Opera anymore :/

2 years agoperl: finalise v5.26 release
Mischa POSLAWSKY [Tue, 23 May 2017 16:44:33 +0000 (18:44 +0200)]
perl: finalise v5.26 release

2 years agolatin: unrestricted width of sample column
Mischa POSLAWSKY [Tue, 30 May 2017 02:22:36 +0000 (04:22 +0200)]
latin: unrestricted width of sample column

Fix unwanted word wrapping.

2 years agolatin: moon row in svg
Mischa POSLAWSKY [Sat, 20 May 2017 17:21:40 +0000 (19:21 +0200)]
latin: moon row in svg

Draw glyphs after all as Unicode allocation does not seem to progress.
Hand coded with inspiration from samples in n4128.

2 years agolatin: chromacons description in header title
Mischa POSLAWSKY [Wed, 17 May 2017 13:20:15 +0000 (15:20 +0200)]
latin: chromacons description in header title

Visible outside of source code as it's not a common standard.

2 years agolatin: rename title attribute to name
Mischa POSLAWSKY [Wed, 17 May 2017 13:20:52 +0000 (15:20 +0200)]
latin: rename title attribute to name

Match termcol include, clarify distinction with hovered title.

2 years agosource: recognise [sample] text include references
Mischa POSLAWSKY [Wed, 17 May 2017 23:37:29 +0000 (01:37 +0200)]
source: recognise [sample] text include references

2 years agosource: link back to resulting page
Mischa POSLAWSKY [Wed, 17 May 2017 23:36:40 +0000 (01:36 +0200)]
source: link back to resulting page

2 years agosource: inherit source file date as modification
Mischa POSLAWSKY [Wed, 17 May 2017 13:22:42 +0000 (15:22 +0200)]
source: inherit source file date as modification

2 years agocommon: wrap some long code lines to 78 columns
Mischa POSLAWSKY [Wed, 17 May 2017 13:22:04 +0000 (15:22 +0200)]
common: wrap some long code lines to 78 columns

2 years agosource: delineate console width for any preformatted block
Mischa POSLAWSKY [Wed, 17 May 2017 09:54:15 +0000 (11:54 +0200)]
source: delineate console width for any preformatted block

Adopt sample styling for any text source, which should all have a
(preferred) limit of 78 characters.  Overflows with default tab stop
of 8, but all modern browsers except for msie support customisation.

2 years agosample: modification date of source text
Mischa POSLAWSKY [Wed, 17 May 2017 23:37:58 +0000 (01:37 +0200)]
sample: modification date of source text

2 years agosample: delineate preformatted block
Mischa POSLAWSKY [Wed, 17 May 2017 09:51:45 +0000 (11:51 +0200)]
sample: delineate preformatted block

Indicate line end for a more balanced look and to highlight incorrect
monospace rendering.

2 years agosample: format section titles as html headers
Mischa POSLAWSKY [Wed, 17 May 2017 09:48:43 +0000 (11:48 +0200)]
sample: format section titles as html headers

2 years agosample: html wrapper for unicode text file
Mischa POSLAWSKY [Wed, 17 May 2017 09:45:52 +0000 (11:45 +0200)]
sample: html wrapper for unicode text file

2 years agocommon: bump version to 1.10 v1.10
Mischa POSLAWSKY [Mon, 15 May 2017 22:31:52 +0000 (00:31 +0200)]
common: bump version to 1.10

Mark significant changes since v1.9.

2 years agoindex: explicitly reference sitemap include
Mischa POSLAWSKY [Tue, 16 May 2017 19:41:50 +0000 (21:41 +0200)]
index: explicitly reference sitemap include

Probably ignored by most robots, but advertise it nonetheless.

2 years agotools: git output and pull fallback
Mischa POSLAWSKY [Tue, 16 May 2017 23:37:30 +0000 (01:37 +0200)]
tools: git output and pull fallback

2 years agolatin: common tool to dump static perl include
Mischa POSLAWSKY [Tue, 16 May 2017 19:39:39 +0000 (21:39 +0200)]
latin: common tool to dump static perl include

Move inline code to reusable script.

2 years agotools: atomic creation of include files
Mischa POSLAWSKY [Tue, 16 May 2017 19:32:49 +0000 (21:32 +0200)]
tools: atomic creation of include files

Replace shell redirect by equivalent `sponge` script from moreutils,
which keeps the original contents during creation avoiding downtime
during possibly slow remake.

2 years agohtaccess: defer compression to server configuration
Mischa POSLAWSKY [Tue, 23 May 2017 23:51:08 +0000 (01:51 +0200)]
htaccess: defer compression to server configuration

Local customisation preclude server rules, which should enable compression
of css and javascript as desired.  In any case not site-specific at all.

2 years agoindex: link digits page
Mischa POSLAWSKY [Mon, 24 Apr 2017 03:20:27 +0000 (05:20 +0200)]
index: link digits page

2 years agoindex: link rss feed of git repository
Mischa POSLAWSKY [Thu, 25 May 2017 19:22:30 +0000 (21:22 +0200)]
index: link rss feed of git repository

2 years agoindex: common styling for family name
Mischa POSLAWSKY [Thu, 25 May 2017 17:45:35 +0000 (19:45 +0200)]
index: common styling for family name

Replace inline style by semantic class name (matching vcard microformat
<http://microformats.org/wiki/hcard>).

2 years agoindex: vertical spacing between navigation links
Mischa POSLAWSKY [Thu, 25 May 2017 17:23:12 +0000 (19:23 +0200)]
index: vertical spacing between navigation links

Increase distance to facilitate mobile clicking;
makes the page mobile-friendly according to
<https://search.google.com/search-console/mobile-friendly?url=sheet.shiar.nl>
which recommends elements to be at least 48px apart:
<https://developers.google.com/speed/docs/insights/SizeTapTargetsAppropriately>

2 years agoindex: link sections in columns
Mischa POSLAWSKY [Thu, 25 May 2017 17:18:54 +0000 (19:18 +0200)]
index: link sections in columns

Appropriate HTML5 navigation element can be used safely because unstyled
MSIE versions does not support columns.  Column number hardcoded to enable
center-alignment.

2 years agobrowser: development version cell fallback
Mischa POSLAWSKY [Sun, 28 May 2017 16:39:23 +0000 (18:39 +0200)]
browser: development version cell fallback

2 years agotermcol: distinguish 2C0x and analog ppu
Mischa POSLAWSKY [Sun, 7 May 2017 11:30:32 +0000 (13:30 +0200)]
termcol: distinguish 2C0x and analog ppu

Rename 7-bit digital version and create an analog variant based on NTSC
values, generated by <http://drag.wootest.net/misc/palgen.html> with sRGB
colorimetry and tuned (hue=0, sat=1, bri=.05, con=1, gam=1) to appear
similar to other (overly saturated) versions.

2 years agotermcol: fix reordered msx transparency exception
Mischa POSLAWSKY [Wed, 3 May 2017 21:46:34 +0000 (23:46 +0200)]
termcol: fix reordered msx transparency exception

2 years agositemap: include major subpages
Mischa POSLAWSKY [Tue, 2 May 2017 22:15:42 +0000 (00:15 +0200)]
sitemap: include major subpages

2 years agositemap: update list of pages
Mischa POSLAWSKY [Tue, 2 May 2017 22:12:52 +0000 (00:12 +0200)]
sitemap: update list of pages

2 years agositemap: include file dates in lastmod attribute
Mischa POSLAWSKY [Tue, 2 May 2017 22:02:15 +0000 (00:02 +0200)]
sitemap: include file dates in lastmod attribute

2 years agositemap: warn about undeclared pages
Mischa POSLAWSKY [Tue, 2 May 2017 21:59:57 +0000 (23:59 +0200)]
sitemap: warn about undeclared pages

2 years agositemap: tool to generate static xml
Mischa POSLAWSKY [Tue, 2 May 2017 21:55:49 +0000 (23:55 +0200)]
sitemap: tool to generate static xml

Effectively the same results but easier to maintain.

2 years agorobots: host directive to reduce mirror crawling
Mischa POSLAWSKY [Tue, 2 May 2017 21:35:02 +0000 (23:35 +0200)]
robots: host directive to reduce mirror crawling

Preferred domain to indicate main site for at least Yandex bots:
<https://yandex.com/support/webmaster/controlling-robot/robots-txt.xml#host>

2 years agolatin: delete unused asl font
Mischa POSLAWSKY [Tue, 2 May 2017 21:37:53 +0000 (23:37 +0200)]
latin: delete unused asl font

Reference dropped in commit v1.7-154-g463f433018 (2015-09-22)
[latin: replace asl font by signwriting unicode].

2 years agomove all generated includes into data/
Mischa POSLAWSKY [Tue, 2 May 2017 20:52:17 +0000 (22:52 +0200)]
move all generated includes into data/

2 years agogitignore: include all files in data/
Mischa POSLAWSKY [Tue, 2 May 2017 20:51:47 +0000 (22:51 +0200)]
gitignore: include all files in data/

2 years agotermcol: move generated xcolors include to data/
Mischa POSLAWSKY [Tue, 2 May 2017 20:49:52 +0000 (22:49 +0200)]
termcol: move generated xcolors include to data/

2 years agotermcol: hue order for ppu tables
Mischa POSLAWSKY [Tue, 2 May 2017 20:45:13 +0000 (22:45 +0200)]
termcol: hue order for ppu tables

2 years agotermcol: reindent table handling code
Mischa POSLAWSKY [Tue, 2 May 2017 20:36:47 +0000 (22:36 +0200)]
termcol: reindent table handling code

2 years agotermcol: separate gameboy table rows in cpcboy
Mischa POSLAWSKY [Tue, 2 May 2017 20:36:06 +0000 (22:36 +0200)]
termcol: separate gameboy table rows in cpcboy

2 years agotermcol: shovel knight variant of ppu
Mischa POSLAWSKY [Tue, 2 May 2017 20:00:46 +0000 (22:00 +0200)]
termcol: shovel knight variant of ppu

Colours copied from conversion at <https://en.wikipedia.org/
?title=List_of_video_game_console_palettes&oldid=770553908#NES>
which should match the actual game:
<https://www.reddit.com/r/gamegrumps/comments/1c0ppo/shovel_knight_game_grumps/c9c54av/>

Append custom colours as described at:
<http://yachtclubgames.com/2014/07/breaking-the-nes/>

2 years agotermcol: include and mark duplicate colours in ppu
Mischa POSLAWSKY [Tue, 2 May 2017 19:56:01 +0000 (21:56 +0200)]
termcol: include and mark duplicate colours in ppu

2 years agotermcol: trim 8-colour xcolors palettes
Mischa POSLAWSKY [Tue, 2 May 2017 19:42:02 +0000 (21:42 +0200)]
termcol: trim 8-colour xcolors palettes

2 years agotermcol: optional preset for xcolors include
Mischa POSLAWSKY [Tue, 2 May 2017 19:39:55 +0000 (21:39 +0200)]
termcol: optional preset for xcolors include

Avoid load unless needed.

2 years agotermcol: distinguish separate tbody for shiar32 greyscale rows
Mischa POSLAWSKY [Tue, 2 May 2017 19:31:47 +0000 (21:31 +0200)]
termcol: distinguish separate tbody for shiar32 greyscale rows

2 years agotermcol: greyscale row format like cpc for shiar32
Mischa POSLAWSKY [Tue, 2 May 2017 18:59:32 +0000 (20:59 +0200)]
termcol: greyscale row format like cpc for shiar32

2 years agotermcol: link and describe legacy group
Mischa POSLAWSKY [Tue, 2 May 2017 18:55:48 +0000 (20:55 +0200)]
termcol: link and describe legacy group

2 years agotermcol: make rules to setup xcolors checkout
Mischa POSLAWSKY [Thu, 27 Apr 2017 01:37:09 +0000 (03:37 +0200)]
termcol: make rules to setup xcolors checkout

2 years agocommon: align all preformatted html (debug alerts)
Mischa POSLAWSKY [Fri, 28 Apr 2017 02:41:44 +0000 (04:41 +0200)]
common: align all preformatted html (debug alerts)

2 years agobrowser: makefile rule for wikimedia usage include
Mischa POSLAWSKY [Sat, 29 Apr 2017 23:19:36 +0000 (01:19 +0200)]
browser: makefile rule for wikimedia usage include

2 years agobrowser: only annotate end date of wikimedia data
Mischa POSLAWSKY [Sat, 29 Apr 2017 19:03:52 +0000 (21:03 +0200)]
browser: only annotate end date of wikimedia data

2 years agobrowser: count unknown agent versions as old
Mischa POSLAWSKY [Fri, 28 Apr 2017 00:56:08 +0000 (02:56 +0200)]
browser: count unknown agent versions as old

2 years agobrowser: calculate score multiplier from usage totals
Mischa POSLAWSKY [Fri, 28 Apr 2017 00:38:23 +0000 (02:38 +0200)]
browser: calculate score multiplier from usage totals

Include hidden agents in total, more direct code.

2 years agobrowser: truncate maximum usage score to 99
Mischa POSLAWSKY [Thu, 27 Apr 2017 23:31:34 +0000 (01:31 +0200)]
browser: truncate maximum usage score to 99

Even in theory 100% should be impossible.

2 years agobrowser: name loop variable of version header cells
Mischa POSLAWSKY [Fri, 28 Apr 2017 00:02:40 +0000 (02:02 +0200)]
browser: name loop variable of version header cells

2 years agobrowser: append partial match of next cell versions
Mischa POSLAWSKY [Thu, 27 Apr 2017 19:58:01 +0000 (21:58 +0200)]
browser: append partial match of next cell versions

2 years agobrowser: prepare intermediate variable of flat cell versions
Mischa POSLAWSKY [Thu, 27 Apr 2017 19:57:14 +0000 (21:57 +0200)]
browser: prepare intermediate variable of flat cell versions

2 years agobrowser: browser and versions in cell titles
Mischa POSLAWSKY [Thu, 27 Apr 2017 18:48:52 +0000 (20:48 +0200)]
browser: browser and versions in cell titles

Increases size by 5kB to 134kB (50kB to 793kB uncompressed)
but greatly improves usability.

2 years agobrowser: update caniuse support classes
Mischa POSLAWSKY [Thu, 27 Apr 2017 18:46:38 +0000 (20:46 +0200)]
browser: update caniuse support classes

Status 'j' can been completely supplanted by 'p'.

2 years agobrowser: round *.0 versions in single cells
Mischa POSLAWSKY [Thu, 27 Apr 2017 15:45:22 +0000 (17:45 +0200)]
browser: round *.0 versions in single cells

Currently only used with multiple versions for Safari, such as "7.0-7.1"
which given as minimum "7.0" represents unnecessary accuracy.

2 years agobrowser: obsolete trimming in version number formatting
Mischa POSLAWSKY [Thu, 27 Apr 2017 15:43:26 +0000 (17:43 +0200)]
browser: obsolete trimming in version number formatting

CanIUse data no longer contains version numbers starting with "."
or ending with "x".

2 years agobrowser: prefer last stable release in versions row
Mischa POSLAWSKY [Thu, 27 Apr 2017 15:42:30 +0000 (17:42 +0200)]
browser: prefer last stable release in versions row

2 years agobrowser: abbreviate multiple releases in versions row titles
Mischa POSLAWSKY [Thu, 27 Apr 2017 15:37:56 +0000 (17:37 +0200)]
browser: abbreviate multiple releases in versions row titles

Individual version numbers are not really of interest (and may not actually
match usage data), and are much better represented as ranges (especially
with the huge amount of Chrome increments).

2 years agobrowser: precalculate row usage values
Mischa POSLAWSKY [Thu, 27 Apr 2017 13:51:38 +0000 (15:51 +0200)]
browser: precalculate row usage values

Trade memory for speed.

2 years agobrowser: omit superfluous usage class
Mischa POSLAWSKY [Thu, 27 Apr 2017 13:40:26 +0000 (15:40 +0200)]
browser: omit superfluous usage class

Unused pp## does not offer anything over p##.

2 years agobrowser: agent versions from appropriate index
Mischa POSLAWSKY [Thu, 27 Apr 2017 13:33:26 +0000 (15:33 +0200)]
browser: agent versions from appropriate index

2 years agobrowser: caniuse data from github repository
Mischa POSLAWSKY [Thu, 27 Apr 2017 01:44:14 +0000 (03:44 +0200)]
browser: caniuse data from github repository

Identical to downloaded json file but includes history and stuff.

2 years agocommon: fix max-age header value
Mischa POSLAWSKY [Thu, 27 Apr 2017 16:03:05 +0000 (18:03 +0200)]
common: fix max-age header value

Invalid since introduction in commit v1.5-22-g423d297ed8 (2013-07-17)
[htaccess: set max-age for plp to a day].

2 years agocommon: html page headers on plp errors
Mischa POSLAWSKY [Thu, 27 Apr 2017 01:36:28 +0000 (03:36 +0200)]
common: html page headers on plp errors

Ensure generic Html if called before page setup.

2 years agocommon: early setup of plp error formatting
Mischa POSLAWSKY [Thu, 27 Apr 2017 01:20:59 +0000 (03:20 +0200)]
common: early setup of plp error formatting

Load at BEGIN to catch compile-time errors.

2 years agocommon: fix initial call to setup debug time
Mischa POSLAWSKY [Thu, 27 Apr 2017 01:15:18 +0000 (03:15 +0200)]
common: fix initial call to setup debug time

Avoid string interpretation if module is not yet known at compile-time.

2 years agobrowser: set caniuse date to exported data value
Mischa POSLAWSKY [Thu, 27 Apr 2017 00:47:46 +0000 (02:47 +0200)]
browser: set caniuse date to exported data value

Field actually added by Alexis shortly after our discussion in 2010,
so no more need to stat file/retrieval date.

2 years agobrowser: strip link urls from cell titles
Mischa POSLAWSKY [Thu, 27 Apr 2017 00:38:40 +0000 (02:38 +0200)]
browser: strip link urls from cell titles

2 years agobrowser: merge renamed browsers
Mischa POSLAWSKY [Thu, 27 Apr 2017 00:34:58 +0000 (02:34 +0200)]
browser: merge renamed browsers

Edge is rebranded IE, Android Browser has merged with Chrome.
Prefer old but more descriptive/recognisable names for now.
No version overlap.

2 years agobrowser: update recognised agents of statcounter
Mischa POSLAWSKY [Thu, 27 Apr 2017 00:36:56 +0000 (02:36 +0200)]
browser: update recognised agents of statcounter

2 years agobrowser: increase agent threshold after new wikimedia data
Mischa POSLAWSKY [Thu, 27 Apr 2017 00:38:25 +0000 (02:38 +0200)]
browser: increase agent threshold after new wikimedia data

2 years agobrowser: new mkusage-wikipedia to parse analytics tsv
Mischa POSLAWSKY [Thu, 27 Apr 2017 00:33:39 +0000 (02:33 +0200)]
browser: new mkusage-wikipedia to parse analytics tsv

Amazing export from analytics.wikimedia.org continuing previous squid stats
but all nicely prepared, only needing translation to caniuse agent identifiers.
Contains all samples, so restrict by year for now.

2 years agobrowser: rename old wikimedia parser to mkusage-squid
Mischa POSLAWSKY [Wed, 26 Apr 2017 23:46:58 +0000 (01:46 +0200)]
browser: rename old wikimedia parser to mkusage-squid

Actual Wikimedia statistics are no longer added in this format, so give
a more appropriate name as it probably matches any auto-generated Squid
server statistics.

2 years agocountries: abbreviate West and East names
Mischa POSLAWSKY [Wed, 26 Apr 2017 21:21:48 +0000 (23:21 +0200)]
countries: abbreviate West and East names

Western Sahara and East Timor to W-Sah and E-Tim.

2 years agobrowser: delete unused data from caniuse include
Mischa POSLAWSKY [Wed, 26 Apr 2017 21:20:40 +0000 (23:20 +0200)]
browser: delete unused data from caniuse include

2 years agobrowser: force perl decode of caniuse json
Mischa POSLAWSKY [Wed, 26 Apr 2017 21:16:50 +0000 (23:16 +0200)]
browser: force perl decode of caniuse json

Avoid XS version if installed to prevent boolean references.

2 years agounicode: minor planets table including pluto
Mischa POSLAWSKY [Wed, 26 Apr 2017 21:23:23 +0000 (23:23 +0200)]
unicode: minor planets table including pluto

Only major bodies in solar group.  Move Pluto with other ex-planets.

2 years agounicode: suprasegmental ipa character group
Mischa POSLAWSKY [Mon, 24 Apr 2017 00:45:08 +0000 (02:45 +0200)]
unicode: suprasegmental ipa character group

2 years agounicode: classify private use characters as unassigned
Mischa POSLAWSKY [Mon, 24 Apr 2017 00:41:48 +0000 (02:41 +0200)]
unicode: classify private use characters as unassigned

Technically in Unicode v6.0 but not safe to use, so l1 style is more
appropriate.

2 years agounicode: secondary ipa header with place categories
Mischa POSLAWSKY [Mon, 24 Apr 2017 00:22:31 +0000 (02:22 +0200)]
unicode: secondary ipa header with place categories

Support multiple > prefixes in header cells to span multiple columns.

2 years agounicode: subtitled code point of original input
Mischa POSLAWSKY [Mon, 24 Apr 2017 00:06:31 +0000 (02:06 +0200)]
unicode: subtitled code point of original input

Fix for diacritics with a string representation.

2 years agounicode: ipa tones and contours tables
Mischa POSLAWSKY [Sun, 23 Apr 2017 23:39:55 +0000 (01:39 +0200)]
unicode: ipa tones and contours tables

2 years agounicode: extend ipa tables including unofficial glyphs
Mischa POSLAWSKY [Sun, 23 Apr 2017 20:44:50 +0000 (22:44 +0200)]
unicode: extend ipa tables including unofficial glyphs

Various proposals from Wikipedia, constructions to fill in some gaps,
and an Articulation row for modifiers.

2 years agounicode: recompile character info on table changes
Mischa POSLAWSKY [Sun, 23 Apr 2017 23:37:50 +0000 (01:37 +0200)]
unicode: recompile character info on table changes

2 years agodigits: include (common) class legend
Mischa POSLAWSKY [Sun, 23 Apr 2017 19:11:37 +0000 (21:11 +0200)]
digits: include (common) class legend

2 years agounicode: support legend in common method
Mischa POSLAWSKY [Sun, 23 Apr 2017 19:10:36 +0000 (21:10 +0200)]
unicode: support legend in common method

2 years agowriting: consistent cell class in legend
Mischa POSLAWSKY [Sun, 23 Apr 2017 19:00:23 +0000 (21:00 +0200)]
writing: consistent cell class in legend

Enforce .X, adding it on .ex column.

2 years agowriting: common method to display (univer) legend
Mischa POSLAWSKY [Sun, 23 Apr 2017 18:59:28 +0000 (20:59 +0200)]
writing: common method to display (univer) legend

2 years agolatin: d'ni border colour on dark background
Mischa POSLAWSKY [Sun, 23 Apr 2017 01:14:41 +0000 (03:14 +0200)]
latin: d'ni border colour on dark background

2 years agosource: link include files with dashes and subdirectories
Mischa POSLAWSKY [Sun, 23 Apr 2017 01:04:58 +0000 (03:04 +0200)]
source: link include files with dashes and subdirectories

For example writing-* and digraphs data.