The website has been slow for some time. I think it is because of increased disk-io. In this post: FreeBSD 12.0 PostgreSQL 11.5 LibreNMS does the graphs via SNMP The diskio overall By increased, I mean it has gone from about 0.1k to about 1.6k, peaking to 140-150. This is steady and persistent. This graphs […]
Website slowness – the investigation Read More »
When the time comes, and the FreeBSD project is using git, there will be work to be done on FreshPorts. If the commit emails are similar to those under cvs and svn, it should be straight forward to parse the email and convert it to XML. Once the data is in XML, the commit can
git and FreshPorts Read More »
I’m writing this post just to keep things straight in my head so I can decide how best to resolve this issue. FreshPorts uses /var/db/freshports/cache/spooling on both the ingress jail and the nginx jail. The nginx jail uses it for caching content. Page details are first spooled into /var/db/freshports/cache/spooling before moving it to /var/db/freshports/cache/ports. The
I have a spooling directory issue to fix Read More »
See the issue raised here. On 1 April 2016, we had some large commits (you can see them all here). This ground the front page to a halt. But as you can see, that link above loads rather quickly. Why? At first, I thought it was because the date-based page was caching the results. I
Improving the home page query Read More »
A great feature of FreshPorts is the ability to see all the ports which are dependent upon a given port. For example, it allows you to see what ports depend upon security/polarssl. This list is stored in a the port_dependencies table, which looks like this: This information is gathered when a port is updated. The
Display the updated dependencies when a dependent port updates Read More »
New categories in the FreeBSD ports tree do not come along often, but when they do, FreshPorts is ready to pull the details in and get the category name right. def ProcessCategoryNew(): syslog.syslog(syslog.LOG_NOTICE, ‘We have a new category’) urllib.urlretrieve(“http://www.freebsd.org/cgi/cvsweb.cgi/~checkout~/www/en/ports/categories?rev=HEAD;content-type=text%2Fplain”, ‘/usr/websites/freshports.org/dynamic/caching/tmp/categories’); Touch(WWWENPortsCategoriesFlag) Touch(JOBWAITING) No. It’s not. That’s cvs. Won’t work. It will redirect to https://svnweb.freebsd.org/ports/head/en/ports/categories and
Today, kwm mentioned that http://www.freshports.org/Mk/bsd.port.mk was out of date, showing the most recent commit as back in March. My first concern was the system had stopped recording such commits. To check on that, I looked at https://svnweb.freebsd.org/ports/head/Mk/bsd.port.mk and searched my email for the most recent commit message. Extracting the message id from that email, I
cache invalidation Read More »
emmh wrote to mention that the vuxml posts on FreshPorts were out of date. I checked. Sure enough. They were. Checking the sites On the homepage, under Latest Vulnerabilities, the latest entry was dated Oct 17. And here it was, November. Something is wrong. The beta website showed Aug 14. And my dev website showed
vuxml updates not being posted Read More »
Wesley Shields (wxs@) wrote in to point out that the commits for Mk/bsd.sites.mk where not showing up correctly. Not sure if you know about this or not but it appears that (at least) Mk/bsd.sites.mk is not being properly updated on freshports since August 5. I compared these two URLS: http://www.freshports.org/Mk/bsd.sites.mk http://dev.freshports.org/Mk/bsd.sites.mk Yep. The full commits
Wrong path on src commits Read More »
The new virtual category docs was recently added. Interestingly enough, FreshPorts has a /docs/ directory, which directly conflics with this. As such, if you were to browe to http://www.freshports.org/docs/, you’d see this: Index of /docs Name Last modified Size Description Parent Directory – 404-for-virtual-pages.php 25-Oct-2007 12:57 8.2K Using 404 errors to serve up virtual pages
Virtual category: docs Read More »