I need some help with the git processing shell script. Look at line 82 in this script please. See those hardcoded branch names? That’s my problem. Let’s reduce the shell script to a simple proof of concept. % cat ~/tmp/poc.sh #!/bin/sh git for-each-ref –format ‘%(objecttype) %(refname)’ \ | sed -n ‘s/^commit refs\/remotes\///p’ \ | while […]
Help needed with shell scripting Read More »
Recently I started seeing this message in the production logs for FreshPorts: What code produces that message? GitHub makes searching for that message easy. I found it here: What port has this issue? Searching the webserver logs, I find: Always be able to reproduce the issue If I cannot reproduce the issue myself, I cannot
pkg-message: UCL type gives: _pkgmessage_UCL found a type is it not prepared for : Array Read More »
These are the steps I’m following to add the ports_to_refresh table. This is a list of issues I will track through this upgrade. branch badge not populated for commits on branch #327 base/binutils page broken #328 Wrong info about hplip-plugin port when using search #322 Package message not presented for x11/nvidia-hybrid-graphics/files/pkg-message.in … #321 404: Warning:
Adding the ports_to_refresh table Read More »
Ports come and go. Sometimes they come back. Take a recent commit on 1 July against editors/ved (and others). This port was created on 01 Jan 2001 and removed on 15 May 2014 because it used the deprecated smake. The 1 July 2021 commit brought it back. There was a problem. Here is the page
When a deleted port is resurrected Read More »
Today I discovered a problem which required the reprocessing of about 400 commits. How is that accomplished? delete the commits from the database tell the ingress daemon to start processing from commit x Deleting This works so long as all the commits have been process in order. The canonical method would query git to get
Rerunning all commits from a given point Read More »
Today at about 1:00 pm Philadelphia time, the website went offline. It was still there, it just could not answer any queries. In this post: Website and database server running in AWS FreeBSD 12.2 on a t3.medium EC2 instance PostgreSQL 12.5 running on a db.t2.large RDS instance Initial look Looking at load, it was acceptable:
lack of index brings website to a crawl Read More »
This post is a how-to and reminder for myself. I’m working on finding a better way for FreshPorts to know a new physical ports category when it finds it. I think the only way is to look at the directories in the FreeBSD ports repo. A discussion on IRC led to this shell script: [dan@devgit-ingress01:/var/db/ingress/repos/ports]
Generating XML for a single commit Read More »
In this post I’ll talk about how the code intially took the easy way out and how recent changes have tightened that up. In short, the code would raise N messages when just a single notification is sufficient. Today the full vuxml database was reloaded into FreshPorts. This affects approximately 3454 ports and the marking
Changing how we record ports which need cache clearing Read More »
A recent post on the FreeBSD Ports mailing list asked: Hi, I noticed a big difference between the number of ports on freebsd.org/ports/ and on freshports.org. Currently, it’s 33348 vs. 41346. The freebsd.org’s number equals roughly the number of lines of a current INDEX, but how does FreshPorts count? Best, Moritz In short, they are
How many ports are there? Read More »
Today I’m working on https://devgit.freshports.org and fixing links to http://github.com/freebsd/freebsd-ports/ for individual commits. Some of these links are stunted to: commit/c2b0677 (i.e. no hostname) A theory I think I know why. The repo_id field of the commit_log table is empty. This field links to the commit to a specific row in the repo table. That
Fixing links to git repo Read More »