From 61ea13874dcce5bd0dcf92fdd2c78bc317ee938e Mon Sep 17 00:00:00 2001 From: MjSeven Date: Wed, 5 May 2021 20:14:49 +0800 Subject: [PATCH] =?UTF-8?q?=E7=BF=BB=E8=AF=91=E5=AE=8C=E6=88=90?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- ...4 Cross-compiling made easy with Golang.md | 234 ------------------ ...4 Cross-compiling made easy with Golang.md | 228 +++++++++++++++++ 2 files changed, 228 insertions(+), 234 deletions(-) delete mode 100644 sources/tech/20210114 Cross-compiling made easy with Golang.md create mode 100644 translated/tech/20210114 Cross-compiling made easy with Golang.md diff --git a/sources/tech/20210114 Cross-compiling made easy with Golang.md b/sources/tech/20210114 Cross-compiling made easy with Golang.md deleted file mode 100644 index 7e359112b4..0000000000 --- a/sources/tech/20210114 Cross-compiling made easy with Golang.md +++ /dev/null @@ -1,234 +0,0 @@ -[#]: collector: (lujun9972) -[#]: translator: (MjSeven) -[#]: reviewer: ( ) -[#]: publisher: ( ) -[#]: url: ( ) -[#]: subject: (Cross-compiling made easy with Golang) -[#]: via: (https://opensource.com/article/21/1/go-cross-compiling) -[#]: author: (Gaurav Kamathe https://opensource.com/users/gkamathe) - -Cross-compiling made easy with Golang -====== -I learned about Go's cross-compilation capabilities by stepping out of -my comfort zone. -![Person using a laptop][1] - -I work with multiple servers with various architectures (e.g., Intel, AMD, Arm, etc.) when I'm testing software on Linux. Once I've [provisioned a Linux box][2] and the server meets my testing needs, I still have a number of steps to do: - - 1. Download and install prerequisite software. - 2. Verify whether new test packages for the software I'm testing are available on the build server. - 3. Get and set the required yum repos for the dependent software packages. - 4. Download and install the new test packages (based on step #2). - 5. Get and set up the required SSL certificates. - 6. Set up the test environment, get the required Git repos, change configurations in files, restart daemons, etc. - 7. Do anything else that needs to be done. - - - -### Script it all away - -These steps are so routine that it makes sense to automate them and save the script to a central location (like a file server) where I can download it when I need it. I did this by writing a 100–120-line Bash shell script that does all the configuration for me (including error checks). The script simplifies my workflow by: - - 1. Provisioning a new Linux system (of the architecture under test) - 2. Logging into the system and downloading the automated shell script from a central location - 3. Running it to configure the system - 4. Starting the testing - - - -### Enter Go - -I've wanted to learn [Golang][3] for a while, and converting my beloved shell script into a Go program seemed like a good project to help me get started. The syntax seemed fairly simple, and after trying out some test programs, I set out to advance my knowledge and become familiar with the Go standard library. - -It took me a week to write the Go program on my laptop. I tested my program often on my go-to x86 server to weed our errors and improve the program. Everything worked fine. - -I continued relying on my shell script until I finished the Go program. Then I pushed the binary onto a central file server so that every time I provisioned a new server, all I had to do was wget the binary, set the executable bit on, and run the binary. I was happy with the early results: - - -``` -$ wget <myuser>/bins/prepnode -$ chmod  +x ./prepnode -$ ./prepnode -``` - -### And then, an issue - -The next week, I provisioned a fresh new server from the pool, as usual, downloaded the binary, set the executable bit, and ran the binary. It errored out—with a strange error: - - -``` -$ ./prepnode -bash: ./prepnode: cannot execute binary file: Exec format error -$ -``` - -At first, I thought maybe the executable bit was not set. However, it was set as expected: - - -``` -$ ls -l prepnode --rwxr-xr-x. 1 root root 2640529 Dec 16 05:43 prepnode -``` - -What happened? I didn't make any changes to the source code, the compilation threw no errors nor warnings, and it worked well the last time I ran it, so I looked more closely at the error message, `format error`. - -I checked the binary's format, and everything looked OK: - - -``` -$ file prepnode -prepnode: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), statically linked, not stripped -``` - -I quickly ran the following command to identify the architecture of the test server I provisioned and where the binary was trying to run. It was Arm64 architecture, but the binary I compiled (on my x86 laptop) was generating an x86-64 format binary: - - -``` -$ uname -m -aarch64 -``` - -### Compilation 101 for scripting folks - -Until then, I had never accounted for this scenario (although I knew about it). I primarily work on scripting languages (usually Python) coupled with shell scripting. The Bash shell and the Python interpreter are available on most Linux servers of any architecture. Hence, everything had worked well before. - -However, now I was dealing with a compiled language, Go, which produces an executable binary. The compiled binary consists of [opcodes][4] or assembly instructions that are tied to a specific architecture. That's why I got the format error. Since the Arm64 CPU (where I ran the binary) could not interpret the binary's x86-64 instructions, it errored out. Previously, the shell and Python interpreter took care of the underlying opcodes or architecture-specific instructions for me. - -### Cross-compiling with Go - -I checked the Golang docs and discovered that to produce an Arm64 binary, all I had to do was set two environment variables when compiling the Go program before running the `go build` command. - -`GOOS` refers to the operating system (Linux, Windows, BSD, etc.), while `GOARCH` refers to the architecture to build for. - - -``` -`$ env GOOS=linux GOARCH=arm64 go build -o prepnode_arm64` -``` - -After building the program, I reran the `file` command, and this time it showed Arm AArch64 instead of the x86 it showed before. Therefore, I was able to build a binary for a different architecture than the one on my laptop: - - -``` -$ file prepnode_arm64 -prepnode_arm64: ELF 64-bit LSB executable, ARM aarch64, version 1 (SYSV), statically linked, not stripped -``` - -I copied the binary onto the Arm server from my laptop. Now, running the binary (after setting the executable bit on) produced no errors: - - -``` -$ ./prepnode_arm64  -h -Usage of ./prepnode_arm64: -  -c    Clean existing installation -  -n    Do not start test run (default true) -  -s    Use stage environment, default is qa -  -v    Enable verbose output -``` - -### What about other architectures? - -x86 and Arm are two of the five architectures I test software on. I was worried that Go might not support the other ones, but that was not the case. You can find out which architectures Go supports with: - - -``` -`$ go tool dist list` -``` - -Go supports a variety of platforms and operating systems, including: - - * AIX - * Android - * Darwin - * Dragonfly - * FreeBSD - * Illumos - * JavaScript - * Linux - * NetBSD - * OpenBSD - * Plan 9 - * Solaris - * Windows - - - -To find the specific Linux architectures it supports, run: - - -``` -`$ go tool dist list | grep linux` -``` - -As the output below shows, Go supports all of the architectures I use. Although x86_64 is not on the list, AMD64 is compatible with x86_64, so you can produce an AMD64 binary, and it will run fine on x86 architecture: - - -``` -$ go tool dist list | grep linux -linux/386 -linux/amd64 -linux/arm -linux/arm64 -linux/mips -linux/mips64 -linux/mips64le -linux/mipsle -linux/ppc64 -linux/ppc64le -linux/riscv64 -linux/s390x -``` - -### Handling all architectures - -Generatiing binaries for all of the architectures under my test is as simple as writing a tiny shell script from my x86 laptop: - - -``` -#!/usr/bin/bash -archs=(amd64 arm64 ppc64le ppc64 s390x) - -for arch in ${archs[@]} -do -        env GOOS=linux GOARCH=${arch} go build -o prepnode_${arch} -done - -[/code] [code] - -$ file prepnode_* -prepnode_amd64:   ELF 64-bit LSB executable, x86-64, version 1 (SYSV), statically linked, Go BuildID=y03MzCXoZERH-0EwAAYI/p909FDnk7xEUo2LdHIyo/V2ABa7X_rLkPNHaFqUQ6/5p_q8MZiR2WYkA5CzJiF, not stripped -prepnode_arm64:   ELF 64-bit LSB executable, ARM aarch64, version 1 (SYSV), statically linked, Go BuildID=q-H-CCtLv__jVOcdcOpA/CywRwDz9LN2Wk_fWeJHt/K4-3P5tU2mzlWJa0noGN/SEev9TJFyvHdKZnPaZgb, not stripped -prepnode_ppc64:   ELF 64-bit MSB executable, 64-bit PowerPC or cisco 7500, version 1 (SYSV), statically linked, Go BuildID=DMWfc1QwOGIq2hxEzL_u/UE-9CIvkIMeNC_ocW4ry/r-7NcMATXatoXJQz3yUO/xzfiDIBuUxbuiyaw5Goq, not stripped -prepnode_ppc64le: ELF 64-bit LSB executable, 64-bit PowerPC or cisco 7500, version 1 (SYSV), statically linked, Go BuildID=C6qCjxwO9s63FJKDrv3f/xCJa4E6LPVpEZqmbF6B4/Mu6T_OR-dx-vLavn1Gyq/AWR1pK1cLz9YzLSFt5eU, not stripped -prepnode_s390x:   ELF 64-bit MSB executable, IBM S/390, version 1 (SYSV), statically linked, Go BuildID=faC_HDe1_iVq2XhpPD3d/7TIv0rulE4RZybgJVmPz/o_SZW_0iS0EkJJZHANxx/zuZgo79Je7zAs3v6Lxuz, not stripped -``` - -Now, whenever I provision a new machine, I just run this wget command to download the binary for a specific architecture, set the executable bit on, and run the binary: - - -``` -$ wget <myuser>/bins/prepnode_<arch> -$ chmod +x ./prepnode_<arch> -$ ./prepnode_<arch> -``` - -### But why? - -You may be wondering why I didn't save all of this hassle by sticking to shell scripts or porting the program over to Python instead of a compiled language. All fair points. But then I wouldn't have learned about Go's cross-compilation capabilities and how programs work underneath the hood when they're executing on the CPU. In computing, there are always trade-offs to be considered, but never let them stop you from learning. - --------------------------------------------------------------------------------- - -via: https://opensource.com/article/21/1/go-cross-compiling - -作者：[Gaurav Kamathe][a] -选题：[lujun9972][b] -译者：[译者ID](https://github.com/译者ID) -校对：[校对者ID](https://github.com/校对者ID) - -本文由 [LCTT](https://github.com/LCTT/TranslateProject) 原创编译，[Linux中国](https://linux.cn/) 荣誉推出 - -[a]: https://opensource.com/users/gkamathe -[b]: https://github.com/lujun9972 -[1]: https://opensource.com/sites/default/files/styles/image-full-size/public/lead-images/laptop_screen_desk_work_chat_text.png?itok=UXqIDRDD (Person using a laptop) -[2]: https://opensource.com/article/20/12/linux-server -[3]: https://golang.org/ -[4]: https://en.wikipedia.org/wiki/Opcode diff --git a/translated/tech/20210114 Cross-compiling made easy with Golang.md b/translated/tech/20210114 Cross-compiling made easy with Golang.md new file mode 100644 index 0000000000..c0a6e08bfb --- /dev/null +++ b/translated/tech/20210114 Cross-compiling made easy with Golang.md @@ -0,0 +1,228 @@ +[#]: collector: "lujun9972" +[#]: translator: "MjSeven" +[#]: reviewer: " " +[#]: publisher: " " +[#]: url: " " +[#]: subject: "Cross-compiling made easy with Golang" +[#]: via: "https://opensource.com/article/21/1/go-cross-compiling" +[#]: author: "Gaurav Kamathe https://opensource.com/users/gkamathe" + +Golang 的交叉编译 +====== +通过走出我的舒适区，我了解了 Go 的交叉编译功能。 +![Person using a laptop][1] + +在 Linux 上测试软件时，我使用各种架构的服务器，例如 Intel、AMD、Arm 等。当我[配置了 Linux 机器][2] 并且当服务器满足我的测试需求后，我仍然需要执行许多步骤： + + 1. 下载并安装必备软件 + 2. 验证构建服务器上是否有新的测试软件包 + 3. 获取并设置依赖软件包所需的 yum 仓库 + 4. 下载并安装新的测试软件包（基于步骤 2） + 5. 获取并设置必需的 SSL 证书 + 6. 设置测试环境，获取所需的 Git 仓库，更改配置，重新启动守护进程等 + 7. 做其他需要做的事情 + +### 自动化 + +这些步骤非常固定，以至于有必要对其进行自动化并将脚本保存到中央位置（例如文件服务器），在需要时可以在此处下载脚本。为此，我编写了 100-120 行的 Bash shell 脚本，它为我完成了所有配置（包括错误检查）。它简化了我的工作流程，通过： + + 1. 配置新的 Linux 系统（支持测试的架构） + 2. 登录系统并从中央位置下载自动化 shell 脚本 + 3. 运行它来配置系统 + 4. 开始测试 + +### Go 来了 + +我想学习 [Golang][3] 有一段时间了，将我心爱的 Shell 脚本转换为 Go 程序似乎是一个很好的项目，可以帮助我入门。语法看起来很简单，在尝试了一些测试程序后，我开始着手提高自己的知识并熟悉 Go 标准库。 + +我花了一个星期的时间在笔记本电脑上编写 Go 程序。我经常在我的 x86 服务器上测试程序，清除错误并使程序健壮起来，一切都很顺利。 + +我继续依赖自己的 shell 脚本，直到完全转换到 Go 程序为止。然后，我将二进制文件推送到中央文件服务器上，以便每次配置新服务器时，我要做的就是获取二进制文件，将可执行标志打开，然后运行二进制文件。我对早期的结果很满意： + + +```bash +$ wget http://file.example.com//bins/prepnode +$ chmod +x ./prepnode +$ ./prepnode +``` + +### 然后，出现了一个问题 + +第二周，我从资源池中配置了一个新的服务器，像往常一样，我下载了二进制文件，设置了可执行标志，然后运行二进制文件。但这次它出错了，是一个奇怪的错误： + + +```bash +$ ./prepnode +bash: ./prepnode: cannot execute binary file: Exec format error +$ +``` + +起初，我以为可能没有成功设置可执行标志。但是，它已按预期设置： + + +```bash +$ ls -l prepnode +-rwxr-xr-x. 1 root root 2640529 Dec 16 05:43 prepnode +``` + +发生了什么事？我没有对源代码进行任何更改，编译没有引发任何错误或警告，而且上次运行时效果很好，因此我仔细查看了错误消息 `format error`。 + +我检查了二进制文件的格式，一切看起来都没问题： + + +```bash +$ file prepnode +prepnode: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), statically linked, not stripped +``` + +我迅速运行了以下命令，识别所配置的测试服务器的架构以及二进制试图运行的平台。它是 Arm64 架构，但是我编译的二进制文件（在我的 x86 笔记本电脑上）生成的是 x86-64 格式的二进制文件： + + +```bash +$ uname -m +aarch64 +``` + +### 面向脚本编写人员的编译第一课 + +在那之前，我从未考虑过这种情况（尽管我知道这一点）。我主要研究脚本语言（通常是 Python）以及 Shell 脚本。在任何架构的大多数 Linux 服务器上都可以使用 Bash Shell 和 Python 解释器。总之，之前一切都很顺利。 + +但是，现在我正在处理 Go 这种编译语言，它生成可执行的二进制文件。编译的二进制文件包括特定架构的[指令码][4] 或汇编指令，这就是为什么我收到格式错误的原因。由于 Arm64 CPU（运行二进制文件的地方）无法解释二进制文件的 x86-64 指令，因此它抛出错误。以前，shell 和 Python 解释器为我处理了底层指令码或特定架构的指令。 + +### Go 的交叉编译 + +我检查了 Golang 的文档，发现要生成 Arm64 二进制文件，我要做的就是在运行 `go build` 命令编译 Go 程序之前设置两个环境变量。 + +`GOOS` 指的是操作系统，例如 Linux、Windows、BSD 等，而 `GOARCH` 指的是要在哪种架构上构建程序。 + + +```bash +$ env GOOS=linux GOARCH=arm64 go build -o prepnode_arm64 +``` + +构建程序后，我重新运行 `file` 命令，这一次它显示的是 Arm AArch64，而不是之前显示的 x86。因此，我在我的笔记本上能为不同的架构构建二进制文件。 + + +```bash +$ file prepnode_arm64 +prepnode_arm64: ELF 64-bit LSB executable, ARM aarch64, version 1 (SYSV), statically linked, not stripped +``` + +我将二进制文件从笔记本电脑复制到 Arm 服务器上。现在运行二进制文件（将可执行标志打开）不会产生任何错误： + + +```bash +$ ./prepnode_arm64  -h +Usage of ./prepnode_arm64: +  -c    Clean existing installation +  -n    Do not start test run (default true) +  -s    Use stage environment, default is qa +  -v    Enable verbose output +``` + +### 其他架构呢？ + +x86 和 Arm 是我测试软件所支持的 5 中架构中的两种，我担心 Go 可能不会支持其它架构，但事实并非如此。你可以查看 Go 支持的架构： + + +```bash +$ go tool dist list +``` + +Go 支持多种平台和操作系统，包括： + + * AIX + * Android + * Darwin + * Dragonfly + * FreeBSD + * Illumos + * JavaScript + * Linux + * NetBSD + * OpenBSD + * Plan 9 + * Solaris + * Windows + +要查找其支持的特定 Linux 架构，运行： + + +```bash +$ go tool dist list | grep linux +``` + +如下面的输出所示，Go 支持我使用的所有体系结构。尽管 x86_64 不在列表中，但 AMD64 兼容 x86-64，所以你可以生成 AMD64 二进制文件，它可以在 x86 架构上正常运行： + + +```bash +$ go tool dist list | grep linux +linux/386 +linux/amd64 +linux/arm +linux/arm64 +linux/mips +linux/mips64 +linux/mips64le +linux/mipsle +linux/ppc64 +linux/ppc64le +linux/riscv64 +linux/s390x +``` + +### 处理所有架构 + +为我测试的所有体系结构生成二进制文件，就像从我的 x86 笔记本电脑编写一个微小的 shell 脚本一样简单： + + +```shell +#!/usr/bin/bash +archs=(amd64 arm64 ppc64le ppc64 s390x) + +for arch in ${archs[@]} +do + env GOOS=linux GOARCH=${arch} go build -o prepnode_${arch} +done + +``` + +``` +$ file prepnode_* +prepnode_amd64: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), statically linked, Go BuildID=y03MzCXoZERH-0EwAAYI/p909FDnk7xEUo2LdHIyo/V2ABa7X_rLkPNHaFqUQ6/5p_q8MZiR2WYkA5CzJiF, not stripped +prepnode_arm64: ELF 64-bit LSB executable, ARM aarch64, version 1 (SYSV), statically linked, Go BuildID=q-H-CCtLv__jVOcdcOpA/CywRwDz9LN2Wk_fWeJHt/K4-3P5tU2mzlWJa0noGN/SEev9TJFyvHdKZnPaZgb, not stripped +prepnode_ppc64: ELF 64-bit MSB executable, 64-bit PowerPC or cisco 7500, version 1 (SYSV), statically linked, Go BuildID=DMWfc1QwOGIq2hxEzL_u/UE-9CIvkIMeNC_ocW4ry/r-7NcMATXatoXJQz3yUO/xzfiDIBuUxbuiyaw5Goq, not stripped +prepnode_ppc64le: ELF 64-bit LSB executable, 64-bit PowerPC or cisco 7500, version 1 (SYSV), statically linked, Go BuildID=C6qCjxwO9s63FJKDrv3f/xCJa4E6LPVpEZqmbF6B4/Mu6T_OR-dx-vLavn1Gyq/AWR1pK1cLz9YzLSFt5eU, not stripped +prepnode_s390x: ELF 64-bit MSB executable, IBM S/390, version 1 (SYSV), statically linked, Go BuildID=faC_HDe1_iVq2XhpPD3d/7TIv0rulE4RZybgJVmPz/o_SZW_0iS0EkJJZHANxx/zuZgo79Je7zAs3v6Lxuz, not stripped +``` + +现在，每当配置一台新机器时，我就运行以下 wget 命令下载特定体系结构的二进制文件，将可执行标志打开，然后运行： + + +```bash +$ wget http://file.domain.com//bins/prepnode_ +$ chmod +x ./prepnode_ +$ ./prepnode_ +``` + +### 为什么？ + +你可能想知道，为什么我没有坚持使用 shell 脚本或将程序移植到 Python 而不是编译语言上来避免这些麻烦。所以有舍有得，那样的话我不会了解 Go 的交叉编译功能，以及程序在 CPU 上执行时的底层工作原理。在计算机中，总要考虑取舍，但绝不要让它们阻碍你的学习。 + +-------------------------------------------------------------------------------- + +via: https://opensource.com/article/21/1/go-cross-compiling + +作者：[Gaurav Kamathe][a] +选题：[lujun9972][b] +译者：[MjSeven](https://github.com/MjSeven) +校对：[校对者ID](https://github.com/校对者ID) + +本文由 [LCTT](https://github.com/LCTT/TranslateProject) 原创编译，[Linux中国](https://linux.cn/) 荣誉推出 + +[a]: https://opensource.com/users/gkamathe +[b]: https://github.com/lujun9972 +[1]: https://opensource.com/sites/default/files/styles/image-full-size/public/lead-images/laptop_screen_desk_work_chat_text.png?itok=UXqIDRDD "Person using a laptop" +[2]: https://opensource.com/article/20/12/linux-server +[3]: https://golang.org/ +[4]: https://en.wikipedia.org/wiki/Opcode \ No newline at end of file