This post documents what I recently put into a gist on Github. It should serve as a rough introduction to how FreshPorts handles packages extracted from packagesite.yaml files. All the platforms These are the plaforms (also known as ABI) for which we are monitoring packages created by the FreeBSD project. They relate to URLs found […]
Packages – how is this data stored? Read More »
Since the last past, I’ve added quarterly packages to the system. I want to outline the changes while I remember the. I will start by outline the tables we have. abi The abi table contains the usual suspects. Entries in this table are added manually, when a new release comes out. See https://pkg.freebsd.org for examples
Packages for latest and quarterly Read More »
This post deals with adding a new feature: A table of which FreeBSD version and architecture has a given package The goal: parse the packagesite.yaml supplied with each repo and load the results into the FreshPorts database. A bunch of the background in the above URL, and I don’t want to repeat it here. This
What packages are now available for this port? Read More »
When I started this, I thought it was be straight forward and take only a few hours at most. It turned into multiple hours over two days. This is part two of a two-part post. The first part dealt with changing a database column from time to timestamp. In this post: PostgreSQL 12.2 Nagios 3.5
creating a Nagios check on a PostgreSQL table Read More »
The plan for today was not decided until after I got out of bed. I sat down with coffee and looked through the list of tasks. I found one which appealed: monitor the cache_clearing_ports & cache_clearing_dates tables This is part one of a two-part story. The first part deals with fixing a database table before
Changing a column type Read More »
FreshPorts had a cache clearing issue recently. It lingered. For a long time. It took me a while to figure it out. It turned out to be a Python 3 compatibility issue. In this post: PostgreSQL 12.1 FreeBSD 12.1 I will outline how database changes invoke external scripts asynchronously which then clear the cache. I
Cache clearing issue Read More »
I’ve noticed a log of sanity test failures related to devel/binutils lately. Every single commit. Issue 133 deals with that. Here, I plan to document what happened. FreshPorts has, since inception, worked off the commit emails. The incoming email is parsed and XML created. The XML is then used to update the database. I started
The slave ports for devel/binutils did not get deleted Read More »
XML can be tricky. XML plays a heavy role in FreshPorts. Since the early days, converting to XML then loading into the database has been a priority. This choice means the database-loading code doesn’t need to know much about the source of the data. It always means we can change the data source without modifying
Code point \u0005 is not a valid character in XML Read More »
The website has been slow for some time. I think it is because of increased disk-io. In this post: FreeBSD 12.0 PostgreSQL 11.5 LibreNMS does the graphs via SNMP The diskio overall By increased, I mean it has gone from about 0.1k to about 1.6k, peaking to 140-150. This is steady and persistent. This graphs
Website slowness – the investigation Read More »
I was just creating a new jail for working on git & FreshPorts. I was intrigued to see that iocage uses send | receive to create the new jail: [dan@slocum:~] $ ps auwwx | grep iocage root 64166 3.7 0.0 12788 4036 1 D+ 21:16 0:06.10 zfs send system/iocage/releases/12.0-RELEASE/root@git-dev root 64167 2.8 0.0 12752 4036
Creating the first FreshPorts git-specific jail Read More »