Ubuntu – frans goes blog

Operating systems: now and then, what next?

Ubuntu on HP Elitebook x360 (screenshot). There are multiple operating systems you can operate. Some are feature-rich, some not so much. While those who are enthusiastic and passionate about these kinds of things continue to be passionate, the actual differences between systems where you can operate are growing less and less important, year by year.

The basics of digital environments are today “good enough”, pretty much everywhere you go.

There are certain significant differences still, of course. Windows has the legacy of great popularity over decades in highly heterogeneous, work and private use contexts. It has a huge backlog of software and hardware that has been created or supported in Windows computers. This is both a blessing and a challenge. It is very difficult to produce a new version of the OS that would not conflict with some software, or some driver-hardware combination out there, as the recent hurdles of Windows 10 upgrade installations have proved.

Apple Macintosh users have more often been left in the cold, as there has been many devices which never came with drivers to make them work with a Mac. There has been arguably a lot of high quality, professional software available for Macs, but in purely numeric terms, Windows software ecosystem is order of magnitude larger.

A bit similarly, iOS (the operating system for Apple mobile devices) is limited by design: there are many restrictions for modifying and customising the default operation and setup of an iOS system. On the other hand, the software developers can rely on highly standardised environment, and users get a very reliable (even if unified and rigid) experience.

There are thus obvious pluses and minuses with the various philosophies that operating systems have adopted, or have been based on.

The current leader, Windows 10 is overall strong in diversity, meaning here particularly the software and hardware support. Be it business software, services or games, Windows is the default environment with most alternatives. On the other hand, a Windows user is challenged by certain loss of control: both the operating system and much of available software and system add-ons and drivers are proprietary. The environment is effectively filled with black boxes that do something – and the user can in most cases only hope that what goes on is based on the right and correct principles. And as there are multiple actors in all Windows installations, the cumulative effects can be surprising: there is Microsoft, trying its best both to introduce new functions and technologies, while at the same time maintaining backward compatibility with their long history of legacy systems. Then there is the OEM (original equipment manufacturer), like Dell or HP, who typically configure their Windows computers with their own, custom-made tools and drivers. Then comes the user, who also installs various kinds of elements into this environment. There is the saying “tårta på tårta” in Swedish – cake upon cake. No-one is capable of carrying responsibility of how the entire conglomerate operates in a Windows computer. In many cases the results are good enough, and the freedom of choice and diversity of support for multiple use cases is what the users are looking for. On the other hand, there is also a well-documented history of bugs and problems related to the piling up effects of the sprawling and ineffective software ecosystem.

As the leading open-source alternative, Linux is known for rather effective use of computing resources. A typical Linux distribution runs well on even ageing computer hardware, and on modern, powerful systems one can really experience what a fast and reliable OS can mean. There are (of course) certain downsides to Linux, as well. The main challenges in this case lie in the somewhat higher threshold of learning. While there are increasingly easy distributions that come pre-configured with graphical tools that allow the non-expert user to take hold of their system, and configure it to their liking, the foundation of Linux is in command-line tools and text-format configuration files. Even today I find that after a new, out-of-the-box Linux distro installation, I feel the need to spend perhaps an hour or two in command line, hunting and installing the various tweaking tools, add-ons and other elements that are lacking in the default installation. But Linux is getting better. Particularly the support for new hardware is now much better than what it used to be ten years ago. While the laptop computer user of Linux in the past would in many cases find out that most of the controllers, special keys and other elements of one’s device would not work at all, or only after considerable efforts, today the situation is different. Most things actually work, which is great. But if something does not work in a Linux installation, one is mostly left to one’s own devices (and for hunting for help in the various community websites online). However, as an alternative example, Lenovo recently announced that they will certify their entire workstation portfolio to run Linux – “every model, every configuration” (see: https://news.lenovo.com/pressroom/press-releases/lenovo-brings-linux-certification-to-thinkpad-and-thinkstation-workstation-portfolio-easing-deployment-for-developers-data-scientists/).

I myself recently configured two laptops with a dual-boot, Windows/Linux setup: Microsoft Surface Pro 4 and HP Elitebook x360 1030 G3. I considered both more challenging devices from a Linux perspective, since these are both two-in-one, hybrid devices with touch screens, which means that they most probably rely on many proprietary drivers to keep all their functionalities running. There were certain challenges (in BIOS/UEFI settings, in configuring the GRUB2 system boot menu, and in the disk partitioning), but Linux itself actually did handle both devices just fine. I was using the most recent, 20.04 release of Ubuntu desktop distribution, but there are several other alternatives that could work just equally well, or even better. Elitebook x360 is my main daily driver, and while my Windows 10 installation makes it run burning hot, fans blowing, Ubuntu is snappy, quiet and cool. And I actually can operate both the touch screen and touchpad with gestures that I have fully customised to my own liking, the active pen is also working fine with the screen, and there are only a couple of things that fall short of Windows 10. The special keys for controlling brigtness do not work (I use control sliders instead), and probably neither does the infrared camera (for facial recognition & login) and the LTE modem (I have not tested it though). One thing that I noticed is that this system sounds currently much better under Windows – the sound system is Bang & Olufsen certified, and they have probably configured the sound drivers and equalizers for optimal sound delivery, as the audio quality of music under Windows perhaps the best of any laptop I have used. But there is a highly detailed software tool, called PulseEffects, available for Linux that allows one to create a customized audio profile – if one is ready to dedicate the time and effort for tweaking and testing. That is the reality of Linux still, for good or bad; but luckily most of the essentials for work use will run just fine, directly out-of-the-box.

As a complete opposite of the high “tweakability” of Linux, iOS/ipadOS systems limit the user possibilities to a radical degree. The upside is then that an iPhone or iPad is very easy to use, one can always find the same settings from same places. It used to be that Apple mobile devices had excellent battery life and system reliability, but could only do one thing at a time. With the launch of iOS/ipadOS 13 (and coming version 14), multitasking became a certain kind of option in iPad Pro devices particularly. One cam also buy (a premium, and rather expensive) “Magic Keyboard” add-on to iPad Pro, and it will come with really nice scissor keys, plus a touchpad that allows mouse-and-keyboard style control of iOS. With iOS 14 there will be some more user-configurable elements added, such as (Android-style) widgets into the desktop. There are inevitable complications related to the added capabilities. iPad Pro which is constantly polling the touchpad (or, burning the back-light in the keyboard) does not have as long battery life as one without it. The multitasking and various split screen modes in ipadOS are rather clumsy and hard to control without considerable dedication into learning new gestures and skills of touch control.

Thus, I would say that we are currently in rather good situation in terms of having several good alternatives to choose from. I myself prefer to have both Windows 10 and Linux installed in my main computers, and keep them updated to their most recent versions. But I also use iOS, ipadOS and Android daily, and all of them have their distinctive strengths and weaknesses. If something does not work in one environment very well, it is often better to try something different, rather than trying to force the operating system out of its own “comfort zone”. I suspect this basic situation will remain the same in the foreseeable future, too.

On Tweakability

Screenshot: Linux Mint 19.2. — Linux Mint 19.2 Tina Cinnamon Edition. (See: https://www.linuxmint.com/rel_tina_cinnamon_whatsnew.php.)

Two years ago, in August 2017, I installed a new operating system into my trusty old home server (HP Proliant ML110 Gen5). That was a rather new Linux distro called ElementaryOS, which looked nice, but the 0.4 Loki that was available at the time was not an optimal choice for a server, as it soon turned out afterwards. It was optimized for a laptop use, and while I could also set it up as a file & printer server, many things required patching and tweaking to start working. But since I install and maintain multiple operating systems in my device environment partly out of curiosity, keeping my brain alert, and for this particular kind of fun – of tweaking – I persisted, and lived with Elementary OS for two years.

Recently, there had been some interesting new versions that had come out from multiple other operating system versions. While I do most of my daily stuff in Windows 10 and in iOS (or ipadOS, as the iPad variant is now called), it is interesting to also try out e.g. different Linux versions, and I am also fan of ChomeOS, which usually does not provide surprises, but rather steadily improves, while staying very clear, simple and reliable in that it does.

In terms of the particular characteristic that I am here talking about – let’s call it “tweakability”– an iPad or Chromebook are pretty much from the opposite ends of spectrum, as compared to a personal computer or server system running some version of Linux. While the other OSs excel in presenting the user with an extremely fine-tuned, clear and simple working environment that is simultaneously rather limited in terms of personalisation and modification, the bare-bones, expert oriented Linux distributions in particular hardly ever are “ready” straight after the initial setup. The basic installation is in these cases rather just the starting point for the user to start building their own vision of an ideal system, complete with the tools, graphical shells, and/or command-line interpreters etc. that suit their ways of working. Some strongly prefer the other, some the opposite style of OS with their associated user experiences. I feel it is optimal to be able to move from one kind of system to another, on basis of what one is trying to do, and also how one wants to do it.

Tweakability is, in this sense, a measure of customisability and modifiability of the system that is particularly important for so-called “power users”, who have a very definite needs, high IT skill levels, and also clear (sometimes idiosyncratic) ideas of how computing should be done. I am personally not entirely comfortable in that style of operation, and often rather feel happy that someone else has set up an easy-to-use system for me, which is good enough for most things. Particularly in those days when it is email, some text editing, browser-based research in databases and publications (with some social media thrown in), a Chromebook, iPad Pro or a Windows machine with a nice keyboard and good enough screen & battery life are all that I need.

But, coming back to that home server and new operating system installation: as my current printer has network sharing, scanning, email and all kinds of apps built-in, and I do not want to run a web server from my home any more either, it is just the basic backup and file server needs that this server box needs to handle. And a modern NAS box with some decent-sized disks could very well do that job. Thus, the setup of this Proliant server is more of less a hobby project that is very much oriented towards optimal tweakability these days (though not quite as much as my experiments with various Raspberry Pi hobby computers, and their operating systems).

So, I finally ended up considering three options as the new OS for this machine: Ubuntu Server 18.04.3 LTS (which would have been a solid choice, but since I was already running Ubuntu in my Lenovo Yoga laptop, I wanted something a bit different). The second option would have been the new Debian 10 (Buster) Minimal Server (probably optimal for my old and small home server use – but I wanted to also experiment with the desktop side of operating system in this installation). So, finally I ended up with Linux Mint 19.2 Tina Cinnamon Edition. It seemed to have the optimal balance between reliable Debian elements, Ubuntu application ecosystem, combined with some nice tweaks that enhance ease of use and also aesthetic side of the OS.

I did a wipe-clean-style installation of Mint into my 120 GB SSD drive, but decided to try and keep all data in the WD Red 4 TB disk. I knew in principle that this could lead into some issues, as in most new operating system installations, the new OS will come with a new user account, and the file systems will keep the files registered into the original User, Group and Other specifications, from the old OS installation. It would have been better to have a separate archive media available with all the folder structures and files, and then format the data disk, copy all data under the new user account, and thereby have all file properties, ownership details etc. exactly right. But I had already accumulated something like 2,7 terabytes of data into this particular disk and there was no exact backup of it all – since this was the backup server itself, for several devices in our house. So, I just read a quick reminder on how chmod and chown commands work again, and proceeded to mount the old data disks within the new Mint installation, take ownership of all directories and data, and tweak the user, group and other permissions into some kind of working order.

Samba, the cross-platform file sharing system that I need for the mixed Windows-Linux local network to operate was the first really difficult part this time. It was just plain confusing to get the right disks, shares and folders to appear in our LAN for the Windows users, so that the backup and file sharing could work. Again, I ended up reading dozens of hobbyist discussions and info pages from different decades and from different forums, making tweak after tweak in users, groups, permissions and settings in the /etc/smb.conf settings file (followed every time to stop and restart the Samba service daemon, to see the effects of changes). After a few hours I got that running, but then the actual fun started, when I tried to install Dropbox, my main cloud archive, backup and sharing system on top of the (terabyte-size) data that I had in my old Dropbox folder. In principle you can achieve this transition by first renaming the old folder e.g. as “Dropbox-OLD”, then starting the new instance of service and letting it create a new folder named “Dropbox”, then killing the software, deleting the new folder and renaming the old folder back to its own default name. After which restarting the Dropbox software should find the old data directory where it expects one to be, and start re-indexing all that data, but not re-downloading all of that from the cloud – which could take several days over a slow home network.

This time, however, something went wrong (I think there was an error in how the “Selective sync” was switched on at certain point), leading into a situation where all the existing folders were renamed by the system as server’s “Conflicting Copy”, then copied into the Dropbox cloud (including c. 330 000 files), while exactly same files and folders were also downloaded back from the cloud into exact same folders, without the “Conflicting Copy” marking. And of course I was away from the machine at this point, so when I realised what was going on, I had to kill Dropbox, and start manually bringing back the Dropbox to the state it was before this mess. It should be noted that there was also a “Rewind Dropbox” feature in this Dropbox Plus account (which is exactly designed for rolling back in this kind of large situations). But I was no longer sure into which point in time I should rewind back to, so I ended up going through about 100 different cases of conflicting copies, and also trying to manually recover various shared project folders that had become dis-joined in this same process. (Btw, apologies to any of my colleagues who got some weird notifications from these project shares during this weekend.)

After spending most of one night doing this, I tried to set up my other old services into the new Mint server installation in the following day. I started from Plex, which is a media server and client software/service system that I use e.g. to stream our family video clips from the server into our smart television. There is an entire, 2600 word essay on Linux file and folder permissions at the Plex site (see: https://support.plex.tv/articles/200288596-linux-permissions-guide/). But in the end I just had to lift my hands up. There is something in the way system sees (or: doesn’t see) the data that is in the old 4 TB disk, and all my tricks with different users and permission settings that I tried, do not allow Plex to see any of that data from that disk. I tested that if I copy the files into that small system disk (the 120 GB SSD), then the server can see and stream them normally. Maybe I will at some point get another large hard drive, try setting up that one under the current OS and user, copy all data there, and then try to reinstall and run Plex again. Meanwhile, I just have to say that I have got my share of tweakability for some time now. I think that Linux Mint in itself is indeed perfectly nice and capable operating system. It is just that software such as Dropbox or Plex do not play so nicely and reliably together with it. Not at least with the tweaking skills that I possess. (While I am writing this, there are currently still over 283 500 files that Dropbox client should restore from the cloud into that problematic data drive. And the program keeps on crashing every few hours…)

Server Update: Elementary Error?

I have been running a Windows server in our basement pretty much nonstop since 2008. Originally a personal Web server, this HP Proliant machine has in recent years mostly worked as a LAN file server for backups, media archives and for home-internal sharing. Even with a new 1.5 terabyte disk installed some years ago, it was running out of disk space. The old Windows 2008 Server was also getting painfully slow.

I decided to do bit of an update, and got a “small” 120 GB SSD for the new system, and a WD Red 4.0 terabyte NAT disk for data. (I also considered their 8 TB “Archive” disk, but I do not need quite that much space, yet, and the “Red” model was a bit faster for my general purpose use. It was also cheaper.)

This time I decided to go Linux way – my aging dual-core Xeon based system is more suitable for a bit lighter OS than a full Windows Server installation. On the other hand I was curious to try newer Linux distributions, so I picked up the “elementary OS”, which has attracted some positive press recently.

The hardware installation took it’s time, but I must say that I respect the build quality of this budget-class Proliant ML110 Gen5 machine. It has been running soon ten years without a single issue (hardware-related, I mean), and it is very solid, and pleasure to open and maintain (something that cannot be said of several consumer oriented computers that I have used).

Installing elementary OS ("loki") — Installing elementary OS (“loki”)

Also the Linux installation, with my Samba and Dropbox components is now finally up and running. But I have to say that I am a bit disappointed with the elementary OS (0.41 “loki”) at the moment. It might have been wrong distribution for my needs, to start with. It surely looks pretty, but it is also very restricted – many essential administrative tools or features are disabled or not available, by design. Apparently it is made so easy and safe for beginners that it is hard to use this “eOS” for most things that Linux normally is used for: development, programming, systems administration.

It is possible to tweak Linux installations, of course, and I have now patched or hacked the new system to be more allowing and capable, but some new issues have emerged in the process. I wonder if it is possible just to overwrite the “elementary” into a regular Ubuntu Server version, for example, or do I need to reinstall everything and lose the work that I have already done? I need to study the wonderful world of Linux distros a bit more, obviously.

Yoga 510, Signature Edition

2017-07-30 18.39.57 At home, I have been setting up and testing a new, dual-boot Win10/Linux system. Lenovo Yoga 510 is a budget-class, two-in-one device that I am currently setting up as a replacement for my old Vivobook (unfortunately, it has a broken power plug/motherboard, now). Technical key specs (510-14ISK, 80S70082MX model, Signature Edition) include an Intel i5-6200U processor (a 2,30-2,80 GHz Skylake model), Intel HD Graphics 520 graphics, 4 GB of DDR4 memory, 128 GB SSD, IPS Full HD (1920 x 1080) 14″ touch-screen display, and a Synaptics touchpad and a backlit keyboard. There is a WiFi (802.11 a/b/g/n/ac) and Bluetooth 4.0. Contrasted to some other, thinner and lighter devices, this one has a nice set of connectors: one USB 2.0, two USB 3.0 ports (no Thunderbolt, though). There is also a combo headphone/mic jack, Harman branded speakers, a memory card slot (SD, SDHC, SDXC, MMC), 720p webcam, and a HDMI connector. There is also a small hidden “Novo Button”, which is needed to get to the BIOS settings.

This is a last-year model (there is already a “Yoga 520” with Kaby Lake chips available), and I got a relatively good deal from Gigantti store (499 euros). (Edit. I forgot to mention this has also a regular, full size wired gigabit ethernet port, which is also nice.)

The strong points (as contrasted to my trusty old Vivobook, that is) are: battery life, which according to my experience and Lenovo promises is over eight hours of light use. The IPS panel is not the best I have seen (MS Surface Pro has really excellent display), but it is still really good as compared to the older, TN panels. Multi-touch also operates pretty well, even if the touchpad is not so much to my taste (its feel is a bit ‘plasticky’, and it uses inferior Synaptics drivers as contrasted to the “precision touchpads”, which send raw data directly to Windows to handle).

2017-08-01 19.21.39 The high point of Lenovo Thinkpad laptops has traditionally been their keyboards. This Yoga model is not one of the professional Thinkpad line, but the keyboard is rather good, as compared to the shallow, non responsive keyboards that seem to be the trend these days. The only real problem is the non-standard positioning of up-arrow/PageUp and RightShift keys – it is really maddening to write, and while touch-typing every Right-Shift press produces erroneous keypress that moves the cursor up (potentially e.g. moving focus to “Send Email” rather than to typing, as I have already witnessed). But this can sort of be fixed by use of KeyTweak or similar tool, which can be used to remap these two keys to other way around. Not optimal, but a small nuisance, really.

2017-07-30 18.41.48 Installing dual boot Ubuntu requires the usual procedures (disabling Secure Boot, fast startup, shrinking the Windows partition, etc.), but in the end Linux runs on this Lenovo laptop really well. The touch screen and all special keys I have tested work flawlessly right after the standard Ubuntu 17.04 installation, without any gimmicky hacking. Having a solid (bit heavy though) laptop with a 14-inch touch-enabled, 360 degree rotating screen, and which can be used without issues in the most recent versions of both Windows 10 and Linux is a rather nice thing. Happy with this, at the moment.

Linux on Vivobook X202E

In January 2013 I bought a Asus Vivobook X202E, a small, budget class, touch screen laptop. It has now served me almost four and a half years – an eternity in ICT terms. For some time it has been upgraded from Windows 8 into Windows 10, which in principle operates rather well. It is just that the operating system eats almost all resources, and it is painfully slow to do anything useful, with contemporary web apps and browsers particularly. Even a Chromebook serves better in that regard.

Last night I tried installing Linux – Ubuntu 17.04 version – into multiboot configuration to X202E. There were certain hurdles in the setup: it was necessary to disable Secure Boot, get into the UEFI/BIOS (fast F2 pressing in boot sequence), disable Fast Boot, enable Lauch CSM (disable Launch PXE OpROM), and enable USB options, in order to make the system bootable from an USB installation stick. (Also, my first attempts were all failures, and it was only when I tried to use another USB stick when the boot from USB disk option came available in UEFI/BIOS.)

Currently, all seems to be ok in Ubuntu, and laptp works much faster than in the Windows side. The battery of this laptop has never been strong, and in its current condition I would say that 2-3 hours is probably maximum it can go, unplugged. Thermal cooling is also weak, but if run ‘indicator-cpufreq’ tool and drop the CPU into slower speeds, the system stays manageable. The reality is, however, that the realistic life cycle of this little machine is coming towards its final rounds. But it is nice to see how Linux can be used to breath some new life into the aging system. Also, the touch controls and gestures are better today in Ubuntu, than they were only few years ago. Linux is not a touch-focused operating system by design, and gestures work rather badly in e.g. Firefox – Chrome is better in that regard. Windows 10 is much more modern in that area, and pen-based computing is something that one can really integrate in one’s daily work flow only in Windows 10. But writing, coding, and various editing tasks for example can be achieved in a small Ubuntu laptop quite nicely. Chromebooks, however, are also making promising steps by opening the vast repositories of Android apps that is good news for hybrid devices and touch-oriented users. Linux remains strong as a geek environment, but when user cultures and mainstream users needs are considered, other software and service ecosystems are currently evolving faster.