Tag Archives: cloud

Cloud Explorer is back with v7.2

Introducing Cloud Explorer 7.2!

Cloud Explorer is a open-source Amazon S3 client that works on any operating system. The program features a graphical or command line interface. Today I just released version 7.2 and hope that you give it a test drive. Feedback and uses cases are always encouraged.

 

What’s new in this release?

To start,  this release of Cloud Explorer was compiled with Java 1.8.0_72 and version 1.10.56 of the Amazon S3 Java Development Kit ( JDK). The major improvements in this release regard file synchronization. Basically, it was mostly rewritten. By putting forth the effort, it helped reduce technical debt and consistency between the command line and graphical version of Cloud Explorer.

 

How do I get it?

Cloud Explorer v7.2 is available under the “Downloads” section of the Release page on GitHub. Simply click on “cloudExplorer-7.2.zip” and the download will begin. When the download is finished, extract the zip file and double click on “CloudExplorer.jar”.

 

Where do we go from here?

I know it has been a while since Cloud Explorer has been touched. It is hard to handle a project all by yourself and keep innovating. I feel that with this release, Cloud Explorer reached a stable point.  I am always looking for new ideas and help from the community. If you are interested in contributing, please contact me or open an issue on the GitHub page.

 

Goodbye Docker on CentOS. Hello Ubuntu!

I have been a hardcore CentOS user for many years now. I enjoyed its minimal install to create a light environment, intuitive installation process, and it’s package manager. Docker is the most popular container format today and provides developers and enthusiasts with an easy way to run workloads in containerized environments. I started using Docker in production at home for about a year now for services such as Plex Media Server, Web Server for this blog, ZNC, MineCraft, and MySQL to name a few. A Dockerfile is a set of instructions used to create a Docker image. I invested many hours creating perfect Dockerfiles using CentOS and Fedora to make deployments simple on any operating system. However, a personal revolution was brewing.

Continue reading Goodbye Docker on CentOS. Hello Ubuntu!

Using LVM cache on Linux with a RAM disk

The Challenge

This is a follow up article from using a USB drive for a LVM cache. I decided to test things further by using a RAM disk instead of a USB drive.

 

The Journey

1. Create a RAM disk:

modprobe brd rd_nr=1 rd_size=4585760 max_part=0

2. Create the cache

pvcreate /dev/ram0
vgextend vg /dev/ram0
lvcreate -L 300M -n cache_meta vg /dev/ram0
lvcreate -L 4G -n cache_vol vg /dev/ram0
lvconvert –type cache-pool –poolmetadata vg/cache_meta –cachemode=writeback vg/cache_vol -y
lvconvert –type cache –cachepool vg/cache_vol vg/docker-pool

3. Run the DD test again

[root@tokyo /]# dd if=/dev/zero of=/tmp/1G bs=1M count=1000
1048576000 bytes (1.0 GB) copied, 1.89586 s, 553 MB/s
[root@tokyo /]# dd if=/dev/zero of=/tmp/1G bs=1M count=1000
1048576000 bytes (1.0 GB) copied, 1.79864 s, 583 MB/s
[root@tokyo /]# dd if=/dev/zero of=/tmp/1G bs=1M count=1000
1048576000 bytes (1.0 GB) copied, 0.922467 s, 1.1 GB/s
[root@tokyo /]# dd if=/dev/zero of=/tmp/1G bs=1M count=1000
1048576000 bytes (1.0 GB) copied, 1.33757 s, 784 MB/s

Average Speed: 736 MB/s

 

Conclusion

In Conclusion, my average write speed is 736 MB/s using LVM caching with a RAM disk. With a USB thumb drive, my average speed is 411.25 MB/s. With no cache, my average speed is 256 MB/s.

 

 

Cloud Explorer 6.0 Released

I have been working hard on new features and GUI enhancements for Cloud Explorer 6.0. I think it is important for an application to improve over time and this project has seen it’s share of visual evolutions. If you look back at the 1.0 release, the changes are night and day. I enjoy the challenge of making this program look pretty for each major release and hope that the users find it to be good. This release uses many free-licenses images and GPL images found in the KDE Desktop Environment.

Getting Cloud Explorer

Cloud Explorer is available for download from here.

Upgrading to 6.0

Starting with Cloud Explorer 5.0 or later, you can upgrade by clicking on Help -> Check for updates. After the update is complete, restart Cloud Explorer.

 

6.0 Changes:

Bug Fixes:

1. Fixed a bug when switching accounts.
2. If no region is specified, it will default to “defaultAWS” to
avoid a null pointer exception. To resolve the issue, delete and
add your account back.
3. If no image is selected when the image button is pressed, nothing
happens.
4. If no music is selected when the play button is pressed, nothing
happens.
5. Support for line spaces in s3.config
6. Versioning display fix.

Improvements:
1. Snapshots and Migration are now located under the new menu
“Snapshots and Migration”.
2. New Icons for GUI.
3. Maximize Window.
4. For improved GUI responsiveness, many actions now avoid
reloading buckets.

New Features:
1. Create Bucket snapshots.
2. Restore Bucket snapshots.

Introducing Cloud Explorer 5.6

Introduction

I am pleased to announce v5.6 of Cloud Explorer.  The biggest new feature for this release allows users to record audio messages that will be saved into their selected bucket.  Cloud Explorer provides a great way to share audio messages because the S3 API allows users to share files via a public URL. Syncing is now more stable intelligent. When syncing to or from a bucket, sync compares the last modified time and if the destination has a newer version, the file will not be copied. The text editor now has a folder list box so users can save notes into a specific folder. This is an excellent way to stay organized and use Cloud Explorer for note taking.

Getting Cloud Explorer

Cloud Explorer is available for download from here.  After downloading, please upgrade to 5.6 if you are running an earlier release.

 

Upgrading to 5.6

Starting with Cloud Explorer 5.0 or later, you can upgrade by clicking on Help -> Check for updates. After the update is complete, restart Cloud Explorer.

 

Here is a complete list of changes in v5.6:

Bug Fixes:
1. Syncing GUI and CLI: Prevent duplicated transfers of synced files in folders and items go in the correct folder when syncing to the local machine,

2. Syncing from CLI: Syncing from S3 saves to appropriate directory level.

Improvements:
1. Music Player:  Plays WAV files, stop button renamed to “Stop /Close” for clarity, and no longer case sensitive for MP3 file extensions.

2. Syncing GUI and CLI: Overwrite button removed.

New Features:
1. Audio recorder.
2. Sync GUI and CLI: Timestamps are compared and the outdated files are overwritten.
3. Folder support for saving files in the Text Editor.

What is new in Cloud Explorer 5.2 ?

What is Cloud Explorer?

Cloud Explorer is a open-source S3 client. It works on Windows, Linux, and Mac. It has a graphical and command line interface for each supported operating system.

Features:

  • Search
  • Performance testing
  • Music player
  • Transition buckets to Amazon Glacier
  • Amazon RRS
  • Migrate buckets between S3 accounts
  • Compress files prior to upload
  • Take screen shots to S3
  • Simple text editor
  • IRC client
  • Share buckets with users
  • Access shared buckets
  • View images
  • Sync folders
  • Graph CSV files and save them to a bucket.

 

What is new in 5.2?

The main new feature in 5.2 is the ability to graph a CSV file from a bucket.

Graph a CSV file.

The text editor  has the ability to substitute and replace text.

There is also a few minor bug fixes. Please see the release notes for more information.

 

Getting Cloud Explorer

Cloud Explorer is available for download from here.  After downloading, please upgrade to 5.2.

 

Upgrading to 5.2

Starting with Cloud Explorer 5.0 or later, you can upgrade by clicking on Help -> Check for updates. After the update is complete, restart Cloud Explorer.

Using Cloud Explorer in a build system for Cloud Explorer

I pondered hard to think how I can make the build process easier for Cloud Explorer by using Cloud Explorer. Currently, I have a bash script that runs and puts files into place locally and compresses the program directory into a zip file. Finally, I have to manually upload Cloud Explorer to the S3 account for sharing. This process involves multiple steps and is tedious to do from different locations. For example, If I want to build a copy at another location, I would have to manually copy the file to my location and then upload with a client. There has to be an easier way.

For a more efficient solution, I added a command line argument for Cloud Explorer that will upload a given file with an object name by my choosing to a specified bucket. After the upload is completed, permissions will be set automatically and configured for sharing.

Example:

java -jar CloudExplorer.jar build $BUILD_NAME $ZIP $BUCKET

The above command is contained in a bash script that runs Cloud Explorer to do the upload. The build argument followed by the remaining arguments runs the program in “Build Mode”. The $BUILD_NAME argument specifies the name of the file when stored on S3. The $ZIP argument contains the location of the Cloud Explorer zip file. The $BUCKET argument specifies the bucket to be used on the S3 server. The account used for the upload will be the first account listed in the ~/s3.config file.

When the build system is ran and the arguments are accepted, Cloud Explorer will perform a parallel multi-part upload of the zip file. Upon completion, the zip file will have public access and a signed URL for simplified sharing. The signed URL will be displayed in the terminal and I can copy and paste it to my peers to download.

By adding this support to Cloud Explorer, I can run my build script and then wait a few minutes to share the build with anybody.

Cloud Explorer is located on Git Hub: https://github.com/rusher81572/cloudExplorer