This post is another in the packages series. It documents how the data is transformed from the raw form (packages_raw) into normalized data (packages). The Packages – how is this data stored? post may be useful reading. The primary purpose of this blog post is documentation of the above mentioned transformation process. Along the way […]
Using DEFERRABLE INITIALLY DEFERRED on constraints Read More »
This is the latest in a series of posts dealing with displaying what packages are available for a given FreeBSD port. The Packages – how is this data stored? post may help you follow along. It outlines the data and the tables used in this post. Last night I managed to get the right data
Procedural vs query approaches Read More »
This post documents what I recently put into a gist on Github. It should serve as a rough introduction to how FreshPorts handles packages extracted from packagesite.yaml files. All the platforms These are the plaforms (also known as ABI) for which we are monitoring packages created by the FreeBSD project. They relate to URLs found
Packages – how is this data stored? Read More »
Since the last past, I’ve added quarterly packages to the system. I want to outline the changes while I remember the. I will start by outline the tables we have. abi The abi table contains the usual suspects. Entries in this table are added manually, when a new release comes out. See https://pkg.freebsd.org for examples
Packages for latest and quarterly Read More »
This post deals with adding a new feature: A table of which FreeBSD version and architecture has a given package The goal: parse the packagesite.yaml supplied with each repo and load the results into the FreshPorts database. A bunch of the background in the above URL, and I don’t want to repeat it here. This
What packages are now available for this port? Read More »
When I started this, I thought it was be straight forward and take only a few hours at most. It turned into multiple hours over two days. This is part two of a two-part post. The first part dealt with changing a database column from time to timestamp. In this post: PostgreSQL 12.2 Nagios 3.5
creating a Nagios check on a PostgreSQL table Read More »
The plan for today was not decided until after I got out of bed. I sat down with coffee and looked through the list of tasks. I found one which appealed: monitor the cache_clearing_ports & cache_clearing_dates tables This is part one of a two-part story. The first part deals with fixing a database table before
Changing a column type Read More »
FreshPorts had a cache clearing issue recently. It lingered. For a long time. It took me a while to figure it out. It turned out to be a Python 3 compatibility issue. In this post: PostgreSQL 12.1 FreeBSD 12.1 I will outline how database changes invoke external scripts asynchronously which then clear the cache. I
Cache clearing issue Read More »
I’ve noticed a log of sanity test failures related to devel/binutils lately. Every single commit. Issue 133 deals with that. Here, I plan to document what happened. FreshPorts has, since inception, worked off the commit emails. The incoming email is parsed and XML created. The XML is then used to update the database. I started
The slave ports for devel/binutils did not get deleted Read More »
XML can be tricky. XML plays a heavy role in FreshPorts. Since the early days, converting to XML then loading into the database has been a priority. This choice means the database-loading code doesn’t need to know much about the source of the data. It always means we can change the data source without modifying
Code point \u0005 is not a valid character in XML Read More »