What’s in the pipeline, how it works, how it’s made…
I asked Claude for this: Look at the FreeBSD ports tree over the past two years of commits. Look for time periods where there is a least a 15 minute gap without commits. Count them, and let me know the times of day they occur. Use UTC. Later, I asked for a 10 year period.
When do commits happen in the FreeBSD ports tree? Read More »
I’m preparing my test database (freshports.dvl) for code which processes Mk/bsd.default-versions. See the following for references: https://github.com/FreshPorts/DefaultVersions https://github.com/FreshPorts/freshports/issues/659 Table creation Today I did this: [15:18 pg01 dvl ~] % cd ~/src [15:18 pg01 dvl ~/src] % git clone https://github.com/FreshPorts/DefaultVersions Cloning into ‘DefaultVersions’… remote: Enumerating objects: 56, done. remote: Counting objects: 100% (56/56), done. remote: Compressing
Creating and populating the tables for DefaultVersions Read More »
This is the first of several post reviewing and documenting the subversion to git conversion process. In short, FreshPorts is split into two parts, which are explained by this high level overview: ingress – getting stuff into the database web – getting stuff from the database That division of labor is not strictly delimited. Typically,
The ingress daemon code Read More »
The code for the front end of FreshPorts is at https://github.com/FreshPorts/freshports/ There are other repos there as well. There are also many repos within my subversion server in the basement homelab. laurent@ has been helping with the conversion process. I have started reviewing his work and comparing it to my development environment to see if
Converting from subversion to git Read More »
Shortly after moving the jail dvl-ingress01 from Python 3.11 to Python 3.12, I started seeing these messages: The code in question ( link to source) is This should be easy enough to replace, knowing python. First, reproduce the problem With any change to fix a problem, I must first be able to reproduce the problem.
One of my favorite FreeBSD features is security/vuxml – from it we get these great tools (provided by pkg): * pkg audit (what installed packages contain known vulnerabilities?) * /usr/local/etc/periodic/security/410.pkg-audit – pkg-audit for host and jails * /usr/local/etc/periodic/security/405.pkg-base-audit – same as above, but for base system I use the latter two command within my monitoring
How FreshPorts processes vuxml entries Read More »
It has been 15 months since the last blog post about clearing out distfiles. It was time again today. This is still not scripted, however, that day may come. The steps were: [7:08 pro05 dvl ~] % ssh aws-1-ingress01 [11:09 aws-1-ingress01 dvl ~] % sudo service freshports stop Stopping freshports. Waiting for PIDS: 3073. [11:09
Clearing out the distfiles Read More »
It’s time to clear old distfiles. Based on Moving distfiles to a new filesystem & deleting unused distfiles, I did the following on the aws-1-ingress01 jail. In short: fetch index list DISTFILES used by index remove DISTFILES not used by index The commands: root@freshports:/usr/ports # make fetchindex /usr/bin/env fetch -am -o /usr/ports/INDEX-14.xz https://download.FreeBSD.org/ports/index/INDEX-14.xz /usr/ports/INDEX-14.xz 1864
Time to clear out the distfiles Read More »
FreshPorts pulls down a lot of distfiles (the file distributed by the software author which contains the software). Much more than your average user. Every distfile for every commit is fetched. Let’s look at my private FreshPorts development instance: [13:18 dvl-ingress01 dvl /jails/freshports/usr/ports] % du -ch -d 0 distfiles 125G distfiles 125G total That’s 125GB.
Moving distfiles to a new filesystem & deleting unused distfiles Read More »
Today I updated the test ingress node of FreshPorts. Not long after, I was told by Nagios monitoring: I had a similar message comparing test to stage. Soon after, I saw this error in the logs: Oct 19 12:18:04 test-ingress01 dvl[12403]: FATAL eror with git-to-freshports-xml.py result: 1 – check git-delta.sh logs for more detail Looking