I spent an evening working through the delete issue with git repos. A Twitter thread was the result. Sergey Kozlov came up with some code changes which changed the XML output. Now I think we have a plan. The commit I’m using for a working example was to editors/nvi2 on 27 Jul 2020 01:58:34 – […]
git – changing libraries gave us new XML options Read More »
I want to document some of the not-visible differences between a git commit and a subversion commit when in the database. subversion git id 808224 808303 message_id 202007091812.069IC6QK044004@repo.freebsd.org a1d2d5b40fba4186daf29b2b2e9ff2dd8b7d8039 message_date 2020-07-09 18:12:06+00 2020-07-09 18:12:06+00 message_subject svn commit: r541803 – in head/devel: . py-absl-py [null] date_added 2020-07-09 18:39:53.510006+00 2020-07-09 18:59:49.863092+00 commit_date 2020-07-09 18:12:06+00 2020-07-09 18:12:06+00 committer
subversion vs git – in the database Read More »
This is another post in the FreshPorts-git series. Yesterday was good progress. This morning (at Sat Jul 4 13:05:10 UTC 2020) I manually initiated another import of commits from git. It looked like this: This created one XML file for each git commit. The files are dropped into the ~freshports/messages-queues/incoming directory. The freshports-git daemon (well,
Manual initiation of git commit processing Read More »
I’m documenting this as a go along because I’m sure I’ll be doing something that I later wish I had written down. Create the repo This creates a FreeBSD git-based port repo. echo git clone https://github.com/freebsd/freebsd-ports.git /var/db/freshports/ports-jail/var/db/repos/PORTS-head-git | sudo su -l freshports The latest local commit This tells us the hash of the latest commit
Setting up a FreeBSD ports git repo for FreshPorts usage Read More »
Recently, a new use of ZFS snapshots was introduced for a cache on FreshPorts. This approach involves creating a snapshot on the empty cache, then rolling back to that snapshot when the cache needs to be cleared. This idea came from this Tweet after much discussion on how to properly and safely delete directory contents
ZFS when you’re not doing ZFS Read More »
git is coming to FreeBSD. The initial FreshPorts work for git started in September, then was abandoned for unknown reasons. It just fell off the RADAR. This week, it came back to my attention. References Some of the initial research was over Twitter. I’m saving those references here for future reference. The Tweet about the
git – the next FreshPorts project Read More »
How long does it take for a new repo to come online. FreshPorts does not have a lot of stats yet, but here is what we have today: Roughly, it’s every two days. The value in repo_date is taken from packagesite.txz as found at https://pkg.freebsd.org/FreeBSD:12:amd64/latest/ for example. What are inserts, updates, deletes? inserts: The number
How often is a new repo available? Read More »
I noticed this today: root 58697 0.0 0.0 10680 2180 – IJ 12May20 0:00.00 /usr/local/bin/readproctitle service errors: …/site_perl/FreshPorts/vuxml_parsing.pm line 232, chunk 1.\nWide character in print at /usr/local/lib/perl5/site_perl/FreshPorts/vuxml_parsing.pm line 232, chunk 1.\nWide character in print at /usr/local/lib/perl5/site_perl/FreshPorts/vuxml_parsing.pm line 232, chunk 1.\nUndefined subroutine &FreshPorts::CommitterOptIn::RecordErrorDetails called at ./process_vuxml.pl line 124, chunk 1.\n I should monitor that process better.
On Sunday, the packages project was moved into production. This project was both fun and challenging. The goal: within 1 hour of the repo being updated, FreshPorts has the packages imported and updated for your viewing pleasure. Today, I went checking to see if a repo update had occurred. An issue was found and corrected.
Packages – now in production Read More »
When a new repo is imported, the packages cache needs to be deleted. The cache is on the front-end, the web server. Cache clearing on the web server is handled by the fp-listen daemon. It does this by using the LISTEN command. The list of channels it listens to is controlled by the listen_for table:
Clearing the packages cache Read More »