FreshPorts News – Page 10 – News and announcements regarding FreshPorts, The Place For Ports

Updating the packages table – INSERT, UPDATE, DELETE – plus some ZFS configuration

Leave a Comment / Development, packages, PostgreSQL / Dan Langille

In the previous post I documented how the packages_raw table is updated to populate the abi_id and port_id columns. This post will discuss how that data is then pushed into the packages table. Thoughts When updates arrive, they arrive in quantity. The latest update was 30474 records. From that, we will have some new packages, […]

Updating the packages table – INSERT, UPDATE, DELETE – plus some ZFS configuration Read More »

Using DEFERRABLE INITIALLY DEFERRED on constraints

Leave a Comment / packages, PostgreSQL / Dan Langille

This post is another in the packages series. It documents how the data is transformed from the raw form (packages_raw) into normalized data (packages). The Packages – how is this data stored? post may be useful reading. The primary purpose of this blog post is documentation of the above mentioned transformation process. Along the way

Using DEFERRABLE INITIALLY DEFERRED on constraints Read More »

Procedural vs query approaches

Leave a Comment / Development, PostgreSQL / Dan Langille

This is the latest in a series of posts dealing with displaying what packages are available for a given FreeBSD port. The Packages – how is this data stored? post may help you follow along. It outlines the data and the tables used in this post. Last night I managed to get the right data

Procedural vs query approaches Read More »

Packages – how is this data stored?

Leave a Comment / Development, packages / Dan Langille

This post documents what I recently put into a gist on Github. It should serve as a rough introduction to how FreshPorts handles packages extracted from packagesite.yaml files. All the platforms These are the plaforms (also known as ABI) for which we are monitoring packages created by the FreeBSD project. They relate to URLs found

Packages – how is this data stored? Read More »

Packages for latest and quarterly

Leave a Comment / Development, packages / Dan Langille

Since the last past, I’ve added quarterly packages to the system. I want to outline the changes while I remember the. I will start by outline the tables we have. abi The abi table contains the usual suspects. Entries in this table are added manually, when a new release comes out. See https://pkg.freebsd.org for examples

Packages for latest and quarterly Read More »

What packages are now available for this port?

Leave a Comment / packages, PostgreSQL / Dan Langille

This post deals with adding a new feature: A table of which FreeBSD version and architecture has a given package The goal: parse the packagesite.yaml supplied with each repo and load the results into the FreshPorts database. A bunch of the background in the above URL, and I don’t want to repeat it here. This

What packages are now available for this port? Read More »

creating a Nagios check on a PostgreSQL table

Leave a Comment / Caching, Development, PostgreSQL / Dan Langille

When I started this, I thought it was be straight forward and take only a few hours at most. It turned into multiple hours over two days. This is part two of a two-part post. The first part dealt with changing a database column from time to timestamp. In this post: PostgreSQL 12.2 Nagios 3.5

creating a Nagios check on a PostgreSQL table Read More »

Changing a column type

Leave a Comment / Caching, Development, PostgreSQL / Dan Langille

The plan for today was not decided until after I got out of bed. I sat down with coffee and looked through the list of tasks. I found one which appealed: monitor the cache_clearing_ports & cache_clearing_dates tables This is part one of a two-part story. The first part deals with fixing a database table before

Changing a column type Read More »

Cache clearing issue

Leave a Comment / Bug fixes, Caching, Development, PostgreSQL, Python / Dan Langille

FreshPorts had a cache clearing issue recently. It lingered. For a long time. It took me a while to figure it out. It turned out to be a Python 3 compatibility issue. In this post: PostgreSQL 12.1 FreeBSD 12.1 I will outline how database changes invoke external scripts asynchronously which then clear the cache. I

Cache clearing issue Read More »

The slave ports for devel/binutils did not get deleted

Leave a Comment / Bug fixes, Development, Sanity Tests / Dan Langille

I’ve noticed a log of sanity test failures related to devel/binutils lately. Every single commit. Issue 133 deals with that. Here, I plan to document what happened. FreshPorts has, since inception, worked off the commit emails. The incoming email is parsed and XML created. The XML is then used to update the database. I started

The slave ports for devel/binutils did not get deleted Read More »