mirror of
https://github.com/arcan1s/arcanis.me.git
synced 2025-04-24 23:37:19 +00:00
252 lines
10 KiB
HTML
252 lines
10 KiB
HTML
---
|
|
category: en
|
|
type: paper
|
|
layout: paper
|
|
hastr: true
|
|
tags: archlinux, configuration, linux
|
|
title: Creating own repository
|
|
short: creating-custom-repo
|
|
description: It is a short paper devoted to creation own ArchLinux repository.
|
|
---
|
|
<h2><a href="#prepare" class="anchor" id="prepare"><span class="octicon octicon-link"></span></a>Prepare</h2>
|
|
<p>First find a server and desire to have sex with it. It is recommended to use Archlinux on it, but it is not necessarily - because you may create special root for Archlinux. Also you need two packages, <code>devtools</code> and <code>pacman</code>:</p>
|
|
|
|
{% highlight bash %}
|
|
pacman -Sy devtools
|
|
{% endhighlight %}
|
|
|
|
<p><a href="//www.archlinux.org/packages/devtools/" title="Archlinux package">devtools</a> is script set for building automation in the clean chroot. I think most of Arch maintainers use it.</p>
|
|
|
|
<p>Let's create working directories and set colors:</p>
|
|
|
|
{% highlight bash %}
|
|
# colors
|
|
if [ ${USECOLOR} == "yes" ]; then
|
|
bblue='\e[1;34m'
|
|
bwhite='\e[1;37m'
|
|
cclose='\e[0m'
|
|
fi
|
|
export USECOLOR
|
|
# directories
|
|
if [ ! -d "${PREPAREDIR}" ]; then
|
|
[ -e "${PREPAREDIR}" ] && error_mes "file" "${PREPAREDIR}"
|
|
echo -e "${bwhite}[II] ${bblue}Creating directory ${bwhite}'${PREPAREDIR}'${cclose}"
|
|
mkdir -p "${PREPAREDIR}" || error_mes "unknown"
|
|
fi
|
|
if [ ! -d "${REPODIR}" ]; then
|
|
[ -e "${REPODIR}" ] && error_mes "file" "${REPODIR}"
|
|
echo -e "${bwhite}[II] ${bblue}Creating directory ${bwhite}'${REPODIR}'${cclose}"
|
|
mkdir -p "${REPODIR}/"{i686,x86_64} || error_mes "unknown"
|
|
fi
|
|
if [ ! -d "${REPODIR}/i686" ]; then
|
|
[ -e "${REPODIR}/i686" ] && error_mes "file" "${REPODIR}/i686"
|
|
echo -e "${bwhite}[II] ${bblue}Creating directory ${bwhite}'${REPODIR}/i686'${cclose}"
|
|
mkdir -p "${REPODIR}/i686" || error_mes "unknown"
|
|
fi
|
|
if [ ! -d "${REPODIR}/x86_64" ]; then
|
|
[ -e "${REPODIR}/x86_64" ] && error_mes "file" "${REPODIR}/x86_64"
|
|
echo -e "${bwhite}[II] ${bblue}Creating directory ${bwhite}'${REPODIR}/x86_64'${cclose}"
|
|
mkdir -p "${REPODIR}/x86_64" || error_mes "unknown"
|
|
fi
|
|
if [ ! -d "${STAGINGDIR}" ]; then
|
|
[ -e "${STAGINGDIR}" ] && error_mes "file" "${STAGINGDIR}"
|
|
echo -e "${bwhite}[II] ${bblue}Creating directory ${bwhite}'${STAGINGDIR}'${cclose}"
|
|
mkdir -p "${STAGINGDIR}" || error_mes "unknown"
|
|
fi
|
|
{% endhighlight %}
|
|
|
|
<p><code>${REPODIR}/{i686,x86_64}</code> are directories for repository, <code>${PREPAREDIR}</code> is directory where compiled packages will be stored, <code>${STAGINGDIR}</code> is one where packages will be built.</p>
|
|
|
|
<h2><a href="#theory" class="anchor" id="theory"><span class="octicon octicon-link"></span></a>A bit of theory</h2>
|
|
<p>Create directory, share it (using <a href="/en/2014/03/06/site-changes/" title="Site changes paper">ftp</a>, for example). It has two subdirectories - <code>i686</code> and <code>x86_64</code> - for each architecture respectively. And fill them with a set of packages.</p>
|
|
|
|
<p>Updating repository may be split into the following steps:</p>
|
|
<ol>
|
|
<li>Creating PKGBUILDs (or updating them from AUR).</li>
|
|
<li>Packages building for each architecture in clean chroot.</li>
|
|
<li>Packages signing.</li>
|
|
<li>Creating the list of packages.</li>
|
|
<li>Repository update:
|
|
<ol><li>Removal old packages from repository.</li>
|
|
<li>Copying new packages</li>
|
|
<li>Repository update.</li></ol>
|
|
</li>
|
|
<li>Cleaning.</li>
|
|
</ol>
|
|
|
|
<h3><a href="#pkgbuild" class="anchor" id="pkgbuild"><span class="octicon octicon-link"></span></a>Creating PKGBUILDs</h3>
|
|
<p>Download source tarballs from AUR:</p>
|
|
|
|
{% highlight bash %}
|
|
cd "${STAGINGDIR}"
|
|
yaourt -G package-name
|
|
{% endhighlight %}
|
|
|
|
<h3><a href="#building" class="anchor" id="building"><span class="octicon octicon-link"></span></a>Packages building</h3>
|
|
<p>Build each package automatically:</p>
|
|
|
|
{% highlight bash %}
|
|
func_build() {
|
|
if [ ${USECOLOR} == "yes" ]; then
|
|
_bblue='\e[1;34m'
|
|
_bwhite='\e[1;37m'
|
|
_cclose='\e[0m'
|
|
fi
|
|
_PREPAREDIR="$1"
|
|
_ROOTDIR="$2"
|
|
eval $(/usr/bin/grep 'arch=' PKGBUILD)
|
|
eval $(/usr/bin/grep 'pkgname=' PKGBUILD)
|
|
echo -e "${_bwhite}[II] ${_bblue}=>${_cclose} Building ${_bwhite}${pkgname}${_cclose}"
|
|
if echo ${arch} | /usr/bin/grep 'any' -q; then
|
|
LC_MESSAGES=C /usr/bin/sudo /usr/bin/staging-i686-build -r "${_ROOTDIR}" -c
|
|
else
|
|
eval $(/usr/bin/grep 'pkgname=' PKGBUILD)
|
|
if echo ${pkgname} | /usr/bin/grep lib32 -q; then
|
|
LC_MESSAGES=C /usr/bin/sudo /usr/bin/multilib-staging-build -r "${_ROOTDIR}" -c
|
|
else
|
|
if /usr/bin/grep 'lib32' PKGBUILD -q; then
|
|
LC_MESSAGES=C /usr/bin/sudo /usr/bin/staging-i686-build -r "${_ROOTDIR}" -c
|
|
LC_MESSAGES=C /usr/bin/sudo /usr/bin/multilib-staging-build -r "${_ROOTDIR}" -c
|
|
else
|
|
LC_MESSAGES=C /usr/bin/sudo /usr/bin/staging-i686-build -r "${_ROOTDIR}" -c
|
|
LC_MESSAGES=C /usr/bin/sudo /usr/bin/staging-x86_64-build -r "${_ROOTDIR}" -c
|
|
fi
|
|
fi
|
|
fi
|
|
/usr/bin/cp *.pkg.tar.xz "${_PREPAREDIR}"
|
|
}
|
|
export -f func_build
|
|
|
|
# building
|
|
echo -e "${bwhite}[II]${cclose} Building packages"
|
|
cd "${STAGINGDIR}"
|
|
/usr/bin/find -name 'PKGBUILD' -type f -execdir /usr/bin/bash -c "func_build "${PREPAREDIR}" "${ROOTDIR}"" \;
|
|
{% endhighlight %}
|
|
|
|
<p>It is recommended to add the following lines to <code>/etc/sudoers</code>:</p>
|
|
|
|
{% highlight bash %}
|
|
username ALL=NOPASSWD: /usr/bin/staging-i686-build
|
|
username ALL=NOPASSWD: /usr/bin/staging-x86_64-build
|
|
username ALL=NOPASSWD: /usr/bin/multilib-staging-build
|
|
{% endhighlight %}
|
|
|
|
<h3><a href="#signing" class="anchor" id="signing"><span class="octicon octicon-link"></span></a>Packages signing</h3>
|
|
|
|
{% highlight bash %}
|
|
# signing
|
|
if [ ${USEGPG} == "yes" ]; then
|
|
echo -e "${bwhite}[II]${cclose} Signing"
|
|
cd "${PREPAREDIR}"
|
|
for PACKAGE in $(/usr/bin/find . -name '*.pkg.tar.xz'); do
|
|
/usr/bin/gpg -b ${PACKAGE}
|
|
done
|
|
fi
|
|
{% endhighlight %}
|
|
|
|
<p>It is recommended to configure <a href="//wiki.archlinux.org/index.php/GPG#gpg-agent" title="ArchWiki">gpg-agent</a>.</p>
|
|
|
|
<h3><a href="#list" class="anchor" id="list"><span class="octicon octicon-link"></span></a>Creating the list of packages</h3>
|
|
|
|
{% highlight bash %}
|
|
# creating packages list
|
|
cd "${PREPAREDIR}"
|
|
i686_PACKAGES=$(/usr/bin/find * -name '*-i686.pkg.tar.xz' -o -name '*-any.pkg.tar.xz')
|
|
x86_64_PACKAGES=$(/usr/bin/find * -name '*-x86_64.pkg.tar.xz' -o -name '*-any.pkg.tar.xz')
|
|
echo -e "${bwhite}[II] ${bblue}=>${cclose} i686 packages: \n${bwhite}${i686_PACKAGES}${cclose}"
|
|
echo -e "${bwhite}[II] ${bblue}=>${cclose} x86_64 packages: \n${bwhite}${x86_64_PACKAGES}${cclose}"
|
|
{% endhighlight %}
|
|
|
|
<h3><a href="#updating" class="anchor" id="updating"><span class="octicon octicon-link"></span></a>Repository update</h3>
|
|
<p>Here is a function for removal packages from database and repository:</p>
|
|
|
|
{% highlight bash %}
|
|
func_remove() {
|
|
_PACKAGE="$1"
|
|
/usr/bin/rm -f "${_PACKAGE}"{,.sig}
|
|
}
|
|
{% endhighlight %}
|
|
|
|
<p><code>i686</code> repository update:</p>
|
|
|
|
{% highlight bash %}
|
|
# updating i686 repo
|
|
echo -e "${bwhite}[II]${cclose} Updating ${bwhite}i686${cclose} repo"
|
|
cd "${REPODIR}/i686"
|
|
for PACKAGE in ${i686_PACKAGES}; do
|
|
PKGNAME=$(/usr/bin/package-query -p -f %n "${PREPAREDIR}/${PACKAGE}")
|
|
for PKG in $(/usr/bin/find "${REPODIR}/i686" -name "${PKGNAME}"'*.pkg.tar.xz'); do
|
|
_PKGNAME=$(/usr/bin/package-query -p -f %n "${PKG}")
|
|
[ "${PKGNAME}" == "${_PKGNAME}" ] && func_remove "${PKG}"
|
|
done
|
|
/usr/bin/cp "${PREPAREDIR}/${PACKAGE}" .
|
|
[ ${USEGPG} == "yes" ] && /usr/bin/cp "${PREPAREDIR}/${PACKAGE}.sig" .
|
|
/usr/bin/repo-add ${DBNAME}.db.tar.gz "${PACKAGE}"
|
|
/usr/bin/repo-add --files ${DBNAME}.files.tar.gz "${PACKAGE}"
|
|
done
|
|
{% endhighlight %}
|
|
|
|
<p><code>x86_64</code> repository update:</p>
|
|
|
|
{% highlight bash %}
|
|
# updating x86_64 repo
|
|
echo -e "${bwhite}[II]${cclose} Updating ${bwhite}x86_64${cclose} repo"
|
|
cd "${REPODIR}/x86_64"
|
|
for PACKAGE in ${x86_64_PACKAGES}; do
|
|
PKGNAME=$(/usr/bin/package-query -p -f %n "${PREPAREDIR}/${PACKAGE}")
|
|
for PKG in $(/usr/bin/find "${REPODIR}/x86_64" -name "${PKGNAME}"'*.pkg.tar.xz'); do
|
|
_PKGNAME=$(/usr/bin/package-query -p -f %n "${PKG}")
|
|
[ "${PKGNAME}" == "${_PKGNAME}" ] && func_remove "${PKG}"
|
|
done
|
|
/usr/bin/cp "${PREPAREDIR}/${PACKAGE}" .
|
|
[ ${USEGPG} == "yes" ] && /usr/bin/cp "${PREPAREDIR}/${PACKAGE}.sig" .
|
|
/usr/bin/repo-add ${DBNAME}.db.tar.gz "${PACKAGE}"
|
|
/usr/bin/repo-add --files ${DBNAME}.files.tar.gz "${PACKAGE}"
|
|
done
|
|
{% endhighlight %}
|
|
|
|
<h3><a href="#clear" class="anchor" id="clear"><span class="octicon octicon-link"></span></a>Cleaning</h3>
|
|
|
|
{% highlight bash %}
|
|
# clear
|
|
cd "${PREPAREDIR}"
|
|
/usr/bin/rm -rf *
|
|
cd "${STAGINGDIR}"
|
|
/usr/bin/rm -rf *
|
|
{% endhighlight %}
|
|
|
|
<h3><a href="#symlinks" class="anchor" id="symlinks"><span class="octicon octicon-link"></span></a>Creating symlinks</h3>
|
|
<p>You may want to create a directory, which will contain symlinks on actual packages with names, which does not contain version:</p>
|
|
|
|
{% highlight bash %}
|
|
# creating symlinks
|
|
if [ ${SYMLINK} == "yes" ]; then
|
|
echo -e "${bwhite}[II]${cclose} Creating symlinks"
|
|
if [ ! -d "${REPODIR}/non-versioned" ]; then
|
|
[ -e "${REPODIR}/non-versioned" ] && error_mes "file" "${REPODIR}/non-versioned"
|
|
echo -e "${bwhite}[II] ${bblue}Creating directory ${bwhite}'${REPODIR}/non-versioned'${cclose}"
|
|
mkdir -p "${REPODIR}/non-versioned" || error_mes "unknown"
|
|
fi
|
|
cd "${REPODIR}/non-versioned"
|
|
for PACKAGE in ${i686_PACKAGES}; do
|
|
PKGNAME=$(/usr/bin/package-query -p -f %n "${REPODIR}/i686/${PACKAGE}")
|
|
/usr/bin/ln -sf "../i686/${PACKAGE}" "${PKGNAME}-i686.pkg.tar.xz"
|
|
done
|
|
for PACKAGE in ${x86_64_PACKAGES}; do
|
|
PKGNAME=$(/usr/bin/package-query -p -f %n "${REPODIR}/x86_64/${PACKAGE}")
|
|
/usr/bin/ln -sf "../x86_64/${PACKAGE}" "${PKGNAME}-x86_64.pkg.tar.xz"
|
|
done
|
|
fi
|
|
{% endhighlight %}
|
|
|
|
<h3><a href="#file" class="anchor" id="file"><span class="octicon octicon-link"></span></a>File</h3>
|
|
<p>Here is <a href="//github.com/arcan1s/repo-scripts" title="GitHub">the scripts</a>. Download source tarballs and run script (editing variables if it is necessary).</p>
|
|
|
|
<h2><a href="#using" class="anchor" id="using"><span class="octicon octicon-link"></span></a>Repository usage</h2>
|
|
<p>Just add following lines to <code>/etc/pacman.conf</code>:</p>
|
|
|
|
{% highlight bash %}
|
|
[$REPONAME]
|
|
Server = ftp://$REPOADDRESS/repo/$arch
|
|
{% endhighlight %}
|