From 5ed420b1c704b9e040e169d72381e246e9dad5f7 Mon Sep 17 00:00:00 2001 From: Xingyu Wang Date: Mon, 18 Nov 2019 14:08:31 +0800 Subject: [PATCH] TSL --- ...et Linux command to recover lost images.md | 132 ------------------ ...et Linux command to recover lost images.md | 132 ++++++++++++++++++ 2 files changed, 132 insertions(+), 132 deletions(-) delete mode 100644 sources/tech/20191025 How I used the wget Linux command to recover lost images.md create mode 100644 translated/tech/20191025 How I used the wget Linux command to recover lost images.md diff --git a/sources/tech/20191025 How I used the wget Linux command to recover lost images.md b/sources/tech/20191025 How I used the wget Linux command to recover lost images.md deleted file mode 100644 index 02cdd087db..0000000000 --- a/sources/tech/20191025 How I used the wget Linux command to recover lost images.md +++ /dev/null @@ -1,132 +0,0 @@ -[#]: collector: (lujun9972) -[#]: translator: (wxy) -[#]: reviewer: ( ) -[#]: publisher: ( ) -[#]: url: ( ) -[#]: subject: (How I used the wget Linux command to recover lost images) -[#]: via: (https://opensource.com/article/19/10/how-community-saved-artwork-creative-commons) -[#]: author: (Seth Kenlon https://opensource.com/users/seth) - -How I used the wget Linux command to recover lost images -====== -The story of the rise and fall of the Open Clip Art Library and the -birth of FreeSVG.org, a new library of communal artwork. -![White shoes on top of an orange tribal pattern][1] - -In 2004, the Open Clip Art Library (OCAL) was launched as a source of free illustrations for anyone to use, for any purpose, without requiring attribution or anything in return. This site was the open source world’s answer to the big stacks of clip art CDs on the shelf of every home office in the 1990s, and to the art dumps provided by the closed-source office and artistic software titles. - -In the beginning, the clip art library consisted mostly of work by a few contributors, but in 2010 it went live with a brand new interactive website, allowing anyone to create and contribute clip art with a vector illustration application. The site immediately garnered contributions from around the globe, and from all manner of free software and free culture projects. A special importer for this library was even included in [Inkscape][2]. - -However, in early 2019, the website hosting the Open Clip Art Library went offline with no warning or explanation. Its community, which had grown to number in the thousands, assumed at first that this was a temporary glitch. The site remained offline, however, for over six months without any clear explanation of what had happened. - -Rumors started to swell. The site was being updated ("There is years of technical debt to pay off," said site developer Jon Philips in an email). The site had fallen to rampant DDOS attacks, claimed a Twitter account. The maintainer had fallen prey to identity theft, another Twitter account claimed. Today, as of this writing, the site’s one and only remaining page declares that it is in "maintenance and protected mode," the meaning of which is unclear, except that users cannot access its content. - -### Recovering the commons - -Sites appear and disappear over the course of time, but the loss of the Open Clip Art Library was particularly surprising to its community because it was seen as a community project. Few community members understood that the site hosting the library had fallen into the hands of a single maintainer, so while the artwork in the library was owned by everyone due to its [Creative Commons 0 License][3], access to it was functionally owned by a single maintainer. And, because the site’s community kept in touch with one another through the site, that same maintainer effectively owned the community. - -When the site failed, the community lost access to its artwork as well as each other. And without the site, there was no community. - -Initially, everything on the site was blocked when it went down. After several months, though, users started recognizing that the site’s database was still online, which meant that a user could access an individual art file by entering its exact URL. In other words, you couldn’t navigate to the art file through clicking around a website, but if you already knew the address, then you could bring it up in your browser. Similarly, technical (or lazy) users realized it was also possible to "scrape" the site with an automated web browser like **wget**. - -The **wget** Linux command is _technically_ a web browser, although it doesn’t let you browse interactively the way you do with Firefox. Instead, **wget** goes out onto the internet and retrieves a file or a collection of files and downloads them to your hard drive. You can then open those files in Firefox or a text editor, or whatever application is most appropriate, and view the content. - -Usually, **wget** needs to know a specific file to fetch. If you’re on Linux or macOS with **wget** installed, you can try this process by downloading the index page for [example.com][4]: - - -``` -$ wget example.org/index.html -[...] -$ tail index.html - -<body><div> -    <h1>Example Domain</h1> -    <p>This domain is for illustrative examples in documents. -    You may use this domain in examples without permission.</p> -        <p><a href="[http://www.iana.org/domains/example"\>More][5] info</a></p> -</div></body></html> -``` - -To scrape the Open Clip Art Library, I used the **\--mirror** option, so that I could point **wget** to just the directory containing the artwork so it could download everything within that directory. This action resulted in four straight days (96 hours) of constant downloading, ending with an excess of 100,000 SVG files that had been contributed by over 5,000 community members. Unfortunately, the author of any file that did not have proper metadata was irrecoverable because this information was locked in inaccessible files in the database, but the CC0 license meant that this issue _technically_ didn’t matter (because no attribution is required with CC0 files). - -A casual analysis of the downloaded files also revealed that nearly 45,000 of them were copies of the same single file (the site’s logo). This was caused by redirects pointing to the site's logo (for reasons unknown), and careful parsing could extract the original destination. Another 96 hours, and all clip art posted on OCAL up to its last day was recovered: **a total of about 156,000 images.** - -SVG files tend to be small, but this is still an enormous amount of work that poses a few very real problems. First of all, several gigabytes of online storage would be needed so the artwork could be made available to its former community. Secondly, a means of searching the artwork would be necessary, because it’s just not realistic to browse through 55,000 files manually. - -It became apparent that what the community really needed was a platform. - -### Building a new platform - -For some time, the site [Public Domain Vectors][6] had been publishing vector art that was in the public domain. While it remains a popular site, open source users often used it only as a secondary source of art because most of the files there were in the EPS and AI formats, both of which are associated with Adobe. Both file formats can generally be converted to SVG but at a loss of features. - -When the Public Domain Vectors site’s maintainers (Vedran and Boris) heard about the loss of the Open Clip Art Library, they decided to create a site oriented toward the open source community. True to form, they chose the open source [Laravel][7] framework as the backend, which provided the site with an admin dashboard and user access. The framework, being robust and well-developed, also allowed them to respond quickly to bug reports and feature requests, and to upgrade the site as needed. The site they are building is called [FreeSVG.org][8], and is already a robust and thriving library of communal artwork. - -Since then they have been uploading all of the clip art from the Open Clip Art Library, and they're even diligently tagging and categorizing the art as they go. As creators of Public Domain Vectors, they are also contributing their own images in SVG format. Their aim is to become the primary resource for SVG images with a CC0 license on the internet. - -### Contributing - -The maintainers of [FreeSVG.org][8] are aware that they have inherited significant stewardship. They are working to title and describe all images on the site so that users can easily find artwork, and will provide this file to the community once it is ready, believing strongly that the metadata about the art belongs to the people that create and use the art as much as the art itself does. They're also aware that unforeseen circumstances can arise, so they create regular backups of their site and content, and intend to make the most recent backup available to the public, should their site fail. - -If you want to add to the Creative Commons content of [FreeSVG.org][9], then download [Inkscape][10] and start drawing. There’s plenty of public domain artwork out there in the world, like [historical advertisements][11], [tarot cards][12], and [storybooks][13] just waiting to be converted to SVG, so you can contribute even if you aren’t confident in your drawing skills. Visit the [FreeSVG forum][14] to connect with and support other contributors. - -The concept of the _commons_ is important. [Creative Commons benefits everyone][15], whether you’re a student, teacher, librarian, small business owner, or CEO. If you don’t contribute directly, then you can always help promote it. - -That’s a strength of free culture: It doesn’t just scale, it gets better when more people participate. - -### Hard lessons learned - -From the demise of the Open Clip Art Library to the rise of FreeSVG.org, the open culture community has learned several hard lessons. For posterity, here are the ones that I believe are most important. - -#### Maintain your metadata - -If you’re a content creator, help the archivists of the future and add metadata to your files. Most image, music, font, and video file formats can have EXIF data embedded into them, and others have metadata entry interfaces in the applications that create them. Be diligent in tagging your work with your name, website or public email, and license. - -#### Make copies - -Don’t assume that somebody else is doing backups. If you care about communal digital content, then back it up yourself, or else don’t count on having it available forever. The trope that _whatever’s uploaded to the internet is forever_ may be true, but that doesn’t mean it’s _available to you_ forever. If the Open Clip Art Library files hadn’t become secretly available again, it’s unlikely that anyone would have ever successfully uncovered all 55,000 images from random places on the web, or from personal stashes on people’s hard drives around the globe. - -#### Create external channels - -If a community is defined by a single website or physical location, then that community is as good as dissolved should it lose access to that space. If you’re a member of a community that’s driven by a single organization or site, you owe it to yourselves to share contact information with those you care about and to establish a channel for communication even when that site is not available. - -For example, [Opensource.com][16] itself maintains mailing lists and other off-site channels for its authors and correspondents to communicate with one another, with or without the intervention or even existence of the website. - -#### Free culture is worth working for - -The internet is sometimes seen as a lazy person’s social club. You can log on when you want and turn it off when you’re tired, and you can wander into whatever social circle you want. - -But in reality, free culture can be hard work. It’s not hard in the sense that it’s difficult to be a part of, but it’s something you have to work to maintain. If you ignore the community you’re in, then the community may wither and fade before you realize it. - -Take a moment to look around you and identify what communities you’re a part of, and if nothing else, tell someone that you appreciate what they bring to your life. And just as importantly, keep in mind that you’re contributing to the lives of your communities, too. - -Creative Commons held its Gl obal Summit a few weeks ago in Warsaw, with amazing international... - --------------------------------------------------------------------------------- - -via: https://opensource.com/article/19/10/how-community-saved-artwork-creative-commons - -作者：[Seth Kenlon][a] -选题：[lujun9972][b] -译者：[译者ID](https://github.com/译者ID) -校对：[校对者ID](https://github.com/校对者ID) - -本文由 [LCTT](https://github.com/LCTT/TranslateProject) 原创编译，[Linux中国](https://linux.cn/) 荣誉推出 - -[a]: https://opensource.com/users/seth -[b]: https://github.com/lujun9972 -[1]: https://opensource.com/sites/default/files/styles/image-full-size/public/lead-images/tribal_pattern_shoes.png?itok=e5dSf2hS (White shoes on top of an orange tribal pattern) -[2]: https://opensource.com/article/18/1/inkscape-absolute-beginners -[3]: https://creativecommons.org/share-your-work/public-domain/cc0/ -[4]: http://example.com -[5]: http://www.iana.org/domains/example"\>More -[6]: http://publicdomainvectors.org -[7]: https://github.com/viralsolani/laravel-adminpanel -[8]: https://freesvg.org -[9]: http://freesvg.org -[10]: http://inkscape.org -[11]: https://freesvg.org/drinking-coffee-vector-drawing -[12]: https://freesvg.org/king-of-swords-tarot-card -[13]: https://freesvg.org/space-pioneers-135-scene-vector-image -[14]: http://forum.freesvg.org/ -[15]: https://opensource.com/article/18/1/creative-commons-real-world -[16]: http://Opensource.com diff --git a/translated/tech/20191025 How I used the wget Linux command to recover lost images.md b/translated/tech/20191025 How I used the wget Linux command to recover lost images.md new file mode 100644 index 0000000000..c7c33f1666 --- /dev/null +++ b/translated/tech/20191025 How I used the wget Linux command to recover lost images.md @@ -0,0 +1,132 @@ +[#]: collector: (lujun9972) +[#]: translator: (wxy) +[#]: reviewer: ( ) +[#]: publisher: ( ) +[#]: url: ( ) +[#]: subject: (How I used the wget Linux command to recover lost images) +[#]: via: (https://opensource.com/article/19/10/how-community-saved-artwork-creative-commons) +[#]: author: (Seth Kenlon https://opensource.com/users/seth) + +我是如何使用 wget 命令恢复丢失的图像的 +====== + +> 开放剪贴画库兴衰的故事以及一个新的公共艺术品图书馆 FreeSVG.org 的诞生。 + +![White shoes on top of an orange tribal pattern][1] + +开放剪贴画库Open Clip Art Library（OCAL）发布于 2004 年，成为了免费插图的来源，任何人都可以出于任何目的使用它们，而无需注明出处或提供任何回报。针对 1990 年代每个家庭办公室书架上的大量剪贴画 CD 以及由闭源公司和艺术品软件提供的艺术品转储，这个网站是开源世界的答复。 + +最初，这个剪贴画库主要由一些贡献者组成，但是在 2010 年，它重新打造成了一个全新的交互式网站，可以让任何人使用矢量插图应用程序创建和贡献剪贴画。该网站立即获得了来自全球的、各种形式的自由软件和自由文化项目的贡献。[Inkscape][2] 中甚至包含了该库的专用导入器。 + +但是，在 2019 年初，托管开放剪贴画库的网站离线，没有任何警告或解释。它已经成长为有着成千上万的人的社区，起初以为这是暂时的故障。 但是，这个站点一直离线已超过六个月，而没有任何清楚的解释。 + +谣言开始膨胀。该网站正在更新中（“要偿还数年的技术债务”，网站开发者 Jon Philips 在一封电子邮件中说）。一个 Twitter 帐户声称，该网站遭受了猖狂的 DDoS 攻击。另一个 Twitter 帐户声称，该网站维护者已经成为身份盗用的牺牲品。今天，在撰写本文时，该网站的一个且唯一的页面声明它处于“维护和保护模式”，其含义不清楚，只是用户无法访问其内容。 + +### 恢复公地 + +网站会随着时间的流逝而消失，但是对其社区而言开放剪贴画库的丢失尤其令人惊讶，因为它被视为一个社区项目。很少有社区成员知道托管该库的站点已经落入一个维护者手中，因此，由于 [CC0 许可证][3]，该库中的艺术品归所有人所有，但对它的访问是功能性的由单个维护者执行。而且，由于该站点的社区通过该站点彼此保持联系，因此该维护者实际上拥有该社区。 + +当站点发生故障时，社区以及彼此之间都无法访问其艺术品。没有该站点，就没有社区。 + +最初，该网站离线后其上的所有东西都是被封挡的。不过，在几个月之后，用户开始意识到该网站的数据库仍然在线，这意味着用户能够通过输入精确的 URL 访问单个剪贴画。换句话说，你不能通过在网站上到处点击来流量剪贴画文件，但是如果你知道该地址，你就可以在浏览器中访问它。类似的，技术型（或偷懒的）用户意识到能够通过类似 `wget` 的自动 Web 浏览器将网站“抓取”下来。 + +Linux 的 `wget` 命令技术上是一个 Web 浏览器，虽然它不能让你像用 Firefox 一样交互式地浏览。相反，`wget` 可以连到互联网，获取文件或文件集，并下载到你的本次硬盘。然后，你可以在 Firefox 或文本编辑器或最合适的应用程序中打开这些文件，然后查看内容。 + +通常，`wget` 需要知道要提取的特定文件。如果你使用的是安装了 `wget` 的 Linux 或 macOS，则可以通过下载 [example.com][4] 的索引页来尝试此过程： + +``` +$ wget example.org/index.html +[...] +$ tail index.html + +
+

Example Domain

+

This domain is for illustrative examples in documents. + You may use this domain in examples without permission.

+

More info

+
+``` + +为了抓取 OCAL，我使用了 `--mirror` 选项，以便可以只是将 `wget` 指向到包含艺术品的目录，就可以下载该目录中的所有内容。此操作导致连续四天（96 个小时）持续下载，最终得到了超过 50000 个社区成员贡献的 100,000 个 SVG 文件。不幸的是，任何没有适当元数据的文件的作者信息都是无法恢复的，因为此信息被锁定在数据库中不可访问的文件中，但是 CC0 许可证意味着此问题*在技术上*无关紧要（因为 CC0 文件不需要属性）。 + +随意分析了一下下载的文件进行还显示，其中近 45,000 个文件是同一文件（该网站的徽标）的副本。这是由于指向该站点徽标的重定向（原因未知）引起的，仔细分析能够提取到原始的文件。又过了 96 个小时，并且恢复了直到最后一天发布在 OCAL 上的所有剪贴画：总共约有 156,000 张图像。 + +SVG 文件通常很小，但这仍然是大量工作，并且会带来一些非常实际的问题。首先，将需要数 GB 的在线存储空间，这样这些剪贴画才能供其先前的社区使用。其次，必须使用一种搜索艺术品的方法，因为手动浏览 55,000 个文件是不现实的。 + +很明显，社区真正需要的是一个平台。 + +### 构建新的平台 + +一段时间以来，[公共领域矢量图][6] 网站一直在发布公共领域的矢量图。虽然它仍然是一个受欢迎的网站，但是开源用户经常将其仅用作辅助的图片资源，因为其中大多数文件都是 EPS 和 AI 格式的，两者均与 Adobe 相关。两种文件格式通常都可以转换为 SVG，但是特性有所损失。 + +当公共领域矢量图网站的维护者（Vedran 和 Boris）得知 OCAL 丢失时，他们决定创建一个面向开源社区的网站。诚然，他们选择了开源 [Laravel][7] 框架作为后端，该框架为网站提供了管理控制台和用户访问权限。该框架功能强大且开发完善，还使他们能够快速响应错误报告和功能请求，并根据需要升级站点。他们正在建立的站点称为 [FreeSVG.org][8]，已经是一个强大而繁荣的公共艺术品图书馆。 + +从那时起，他们就一直从 OCAL 上载所有剪贴画，并且他们甚至在努力地对艺术品进行标记和分类。作为公共领域矢量图网站的创建者，他们还以 SVG 格式贡献了自己的图像。他们的目标是成为互联网上具有 CC0 许可证的 SVG 图像的主要资源。 + +### 贡献 + +[FreeSVG.org][8] 的维护者意识到他们已经继承了重要的管理权。他们正在努力对网站上的所有图像加上标题和描述，以便用户可以轻松找到这些艺术品，并在准备就绪后将其提供给社区，同时坚信与这些艺术品有关的元数据和艺术品属于创建和使用它们的人。他们还意识到可能会发生无法预料的情况，因此他们会定期为其网站和内容创建备份，并打算在其站点出现故障时向公众提供最新备份。 + +如果要为 [FreeSVG.org][9]的知识共享内容添砖加瓦，请下载 [Inkscape][10] 并开始绘制。世界上有很多公共领域的艺术品，例如[历史广告][11]、[塔罗牌][12]和[故事书][13]，只是在等待转换为 SVG，因此即使你对自己的绘画技巧没有信心你也可以做出贡献。访问 [FreeSVG 论坛][14]与其他贡献者联系并支持他们。 + +*公地*的概念很重要。无论你是学生、老师、图书馆员、小企业主还是首席执行官，[知识共享都会使所有人受益][15]。如果你不直接捐款，那么你随时可以帮助推广。 + +这是自由文化的力量：它不仅可以扩展，而且随着更多人的参与，它会变得更好。 + +### 艰难的教训 + +从 OCAL 的消亡到 FreeSVG.org 的兴起，开放文化社区已经吸取了一些艰辛的经验。对于以后，以下是我认为最重要的那些。 + +#### 维护你的元数据 + +如果你是内容创建者，请帮助将来的档案管理员，将元数据添加到文件中。大多数图像、音乐、字体和视频文件格式都可以嵌入 EXIF 数据，其他格式在创建它们的应用程序中具有元数据输入界面。勤于用你的姓名、网站或公共电子邮件以及许可证来标记你的作品。 + +#### 做个副本 + +不要以为别人在做备份。如果你关心公用数字内容，请自己备份，否则不要指望永远提供它。 无论*任何上传到互联网上的内容是永久的*的说法是不是正确的，但这并不意味着你永远可以使用。如果 OCAL 文件不再隐秘地可用，那么任何人都不太可能成功地从网络上的某个位置或从全球范围内的人们的硬盘中成功地发现所有的 55,000 张图像。Make copies + +#### 创建外部渠道 + +如果一个社区是由单个网站或实际位置来定义的，那么该社区失去访问该空间的能力就如同解散了一样。如果你是由单个组织或网站驱动的社区的成员，则你应该自己与关心的人共享联系信息，并即使在该站点不可用时也可以建立沟通渠道。 + +例如，[Opensource.com][16] 本身维护其作者和通讯者的邮件列表和其他异地渠道，以便在有或没有网站干预或甚至没有网站的情况下相互交流。 + +#### 自由文化值得为此努力 + +互联网有时被视为懒人社交俱乐部。你可以在需要时登录并在感到疲倦时将其关闭，也可以漫步到所需的任何社交圈。 + +但实际上，自由文化可能是项艰难的工作。但是这种艰难从某种意义上讲并不是说要成为其中的一部分很困难，而是你必须努力维护。如果你忽略你所在的社区，那么该社区可能会在你才会意识到之前就枯萎并褪色。 + +花点时间环顾四周，确定你属于哪个社区，如果不是，那么请告诉某人你对他们带给你生活的意义表示赞赏。同样重要的是，请记住，这样你也为社区的生活做出了贡献。 + +几周前，知识共享组织在华沙举行了它的全球峰会，令人惊叹的国际盛会... + +-------------------------------------------------------------------------------- + +via: https://opensource.com/article/19/10/how-community-saved-artwork-creative-commons + +作者：[Seth Kenlon][a] +选题：[lujun9972][b] +译者：[wxy](https://github.com/wxy) +校对：[校对者ID](https://github.com/校对者ID) + +本文由 [LCTT](https://github.com/LCTT/TranslateProject) 原创编译，[Linux中国](https://linux.cn/) 荣誉推出 + +[a]: https://opensource.com/users/seth +[b]: https://github.com/lujun9972 +[1]: https://opensource.com/sites/default/files/styles/image-full-size/public/lead-images/tribal_pattern_shoes.png?itok=e5dSf2hS (White shoes on top of an orange tribal pattern) +[2]: https://opensource.com/article/18/1/inkscape-absolute-beginners +[3]: https://creativecommons.org/share-your-work/public-domain/cc0/ +[4]: http://example.com +[5]: http://www.iana.org/domains/example"\>More +[6]: http://publicdomainvectors.org +[7]: https://github.com/viralsolani/laravel-adminpanel +[8]: https://freesvg.org +[9]: http://freesvg.org +[10]: http://inkscape.org +[11]: https://freesvg.org/drinking-coffee-vector-drawing +[12]: https://freesvg.org/king-of-swords-tarot-card +[13]: https://freesvg.org/space-pioneers-135-scene-vector-image +[14]: http://forum.freesvg.org/ +[15]: https://opensource.com/article/18/1/creative-commons-real-world +[16]: http://Opensource.com