May 302020
 

I noticed this today: root 58697 0.0 0.0 10680 2180 – IJ 12May20 0:00.00 /usr/local/bin/readproctitle service errors: …/site_perl/FreshPorts/vuxml_parsing.pm line 232, chunk 1.\nWide character in print at /usr/local/lib/perl5/site_perl/FreshPorts/vuxml_parsing.pm line 232, chunk 1.\nWide character in print at /usr/local/lib/perl5/site_perl/FreshPorts/vuxml_parsing.pm line 232, chunk 1.\nUndefined subroutine &FreshPorts::CommitterOptIn::RecordErrorDetails called at ./process_vuxml.pl line 124, chunk 1.\n I should monitor that process better. […]

May 182020
 
Packages - now in production

On Sunday, the packages project was moved into production. This project was both fun and challenging. The goal: within 1 hour of the repo being updated, FreshPorts has the packages imported and updated for your viewing pleasure. Today, I went checking to see if a repo update had occurred. An issue was found and corrected. […]

Apr 292020
 

When a new repo is imported, the packages cache needs to be deleted. The cache is on the front-end, the web server. Cache clearing on the web server is handled by the fp-listen daemon. It does this by using the LISTEN command. The list of channels it listens to is controlled by the listen_for table: […]

Apr 282020
 

Today, while I wasn’t looking, both dev and test located and imported new package information for: FreeBSD:11:amd64 FreeBSD:11:i386 FreeBSD:12:amd64 FreeBSD:12:i386 FreeBSD:13:amd64 FreeBSD:13:i386 However, the packages table was not correctly updated. Why? Because I lost some function code I wrote. This is the code which was in use, as mentioned in Using DEFERRABLE INITIALLY DEFERRED on […]

Apr 172020
 

In the previous post I documented how the packages_raw table is updated to populate the abi_id and port_id columns. This post will discuss how that data is then pushed into the packages table. Thoughts When updates arrived, they arrive in quantity. The latest update was 30474 records. From that, we will have some new package, […]

Apr 162020
 

This post is another in the packages series. It documents how the data is transformed from the raw form (pacakges_raw) into normalized data (packages). The Packages – how is this data stored? post may be useful reading. The primary purpose of this blog post is documentation of the above mentioned transformation process. Along the way […]

Apr 142020
 

This post documents what I recently put into a gist on Github. It should serve as a rough introduction to how FreshPorts handles packages extracted from packagesite.yaml files. All the platforms These are the plaforms (also known as ABI) for which we are monitoring packages created by the FreeBSD project. They relate to URLs found […]

Apr 122020
 

Since the last past, I’ve added quarterly packages to the system. I want to outline the changes while I remember the. I will start by outline the tables we have. abi The abi table contains the usual suspects. Entries in this table are added manually, when a new release comes out. See https://pkg.freebsd.org for examples […]