Difference between revisions of "Git"

From WikiROMS
Jump to navigationJump to search
(Created page with "<div class="title">Git</div> ROMS source code is distributed using both [https://git-scm.com Git] and [https://subversion.apache.org Subversion](SVN). For details on using Sub...")   (change visibility)
 
 
(14 intermediate revisions by 2 users not shown)
Line 1: Line 1:
<div class="title">Git</div>
<div class="title">Git</div>
ROMS source code is distributed using both [https://git-scm.com Git] and [https://subversion.apache.org Subversion](SVN). For details on using Subversion can be found [[Subversion|here]]. There are command line and GUI Git clients available for nearly every operating system and a list of popular clients can be found [https://git-scm.com/downloads/guis here]. This page will help you get started with downloading ROMS with Git.
ROMS source code is now distributed using [https://git-scm.com Git]. The [https://subversion.apache.org Subversion](SVN) repository is being phased out and will no longer be updated starting January 1<sup>st</sup>, 2025. The GitHub repository includes the full history of changes to the ROMS source code. There are command line and GUI Git clients available for nearly every operating system and a list of popular clients can be found [https://git-scm.com/downloads/guis here]. This page will help you get started with downloading ROMS with Git.
 
 
{{note}}'''Note:''' For instructions using the deprecated and soon to be discontinued myroms.org git repository, click [[Talk:Git|here]].
 
 
{{note}}'''Note:''' Details on using the deprecated and soon to be discontinued Subversion repository can be found [[Subversion|here]].
 


==Git Overview==
==Git Overview==
Git is a free and open source distributed version control system designed to handle everything from small to very large projects with speed and efficiency. All the ROMS/TOMS files are stored in a Git repository on '''www.myroms.org''' with access controlled by requiring authentication with the same ROMS Username/Password combination assigned to registered users of the ROMS Forum.
Git is a free and open source distributed version control system designed to handle everything from small to very large projects with speed and efficiency. All the ROMS/TOMS files are stored in a Git repository on '''github.com'''.
 
This Git repository is the official version of the code which only the developers are allowed to change. Users should download the ROMS code to their local machines using a '''git client'''.  Don't attempt to use a regular web browser to browse or download files from the Git repository - there are much better tools for interacting with the code repository.


This Git repository is the official version of the code which only the developers are allowed to change. Users should download the ROMS code to their local machines using a '''git client'''.  Don't attempt to use a regular web browser to browse or download files from the Git repository - there are much better tools for interacting with the code repository. See the notes below under the heading '''View the Repository'''.
We strongly recommend users always check out the current ''develop'' version since this has the most recent updates and bug fixes. The ''tags'' are kept largely as a historical record of stable releases at the conclusion of major code upgrades.


We strongly recommend users always check out the current ''master'' version since this has the most recent updates and bug fixes. The ''tags'' are kept largely as a historical record of stable releases at the conclusion of major code upgrades.  
If you are making changes of your own, keep them in a separate branch, leaving the ''develop'' branch to track changes from the source. Git makes it ''so'' much easier to manage your own modifications than svn for those of us without write permission on the repository.


Below is a general description of how Git works. Please look at the [https://git-scm.com/book/en/v2 Pro Git] book for more detailed information. We have not yet tried any GUI clients but may add brief how-tos for the most popular GUIs at a later date.
Below is a general description of how Git works. Please look at the [https://git-scm.com/book/en/v2 Pro Git] book for more detailed information. We have not yet tried any GUI clients but may add brief how-tos for the most popular GUIs at a later date.
==Configuring GIT==
Before downloading any of '''ROMS''' repositories, ensure that your '''~/.gitconfig''' has the appropriate '''git-lfs''' configuration for correctly downloading some '''''roms_test''''' input and observation NetCDF files. Otherwise, the '''Test Cases''' requiring input NetCDF files will fail. The '''Git LFS''' is a command line extension and specification for managing large files with '''Git'''. A sample of the configuration file looks like this:<div class="box">more ~/.gitconf<br /><br />  [User]<br />        name = GivenName MiddleName FamilyName<br />        email = your@email<br />  [credential]<br />        helper = cache --timeout=7200<br />        helper = store --file ~/.my-credentials<br />  [filter "lfs"]<br />        clean = git-lfs clean -- %f<br />        smudge = git-lfs smudge -- %f<br />        process = git-lfs filter-process<br />        required = true</div>
Alternatively, you may execute '''git lfs pull''' at your location of this repository to download a viable version of the '''Git LFS''' files from the remote repository in '''GitHub'''. Also, to automatically add the '''LFS''' filter to your existing '''~/.gitconfig''', you could use '''git lfs install''' from anywhere in your computer directories.


==Downloading ROMS==
==Downloading ROMS==
Line 19: Line 34:
     <span class="red">git</span> action <repository>
     <span class="red">git</span> action <repository>


To check-out the files from the ROMS repository '''master''' (latest version), enter (notice https instead of http):
To check-out the files from the ROMS repository '''develop''' (latest version), enter (notice https instead of http):
 
    > <span class="red">git clone <nowiki>https://github.com/myroms/roms.git</nowiki> MyDir</span>
 
where '''MyDir''' is the destination directory on your local computer. It will be created if not found. If '''MyDir''' is omitted the code will be downloaded to a directory named '''roms'''. You only clone once because Git will keep track of the source, destination and a bunch of other information. For more detail on command line use and syntax, see the [https://git-scm.com/book/en/v2 Pro Git] book.


    <span class="red">git clone <nowiki>https://www.myroms.org/git/src</nowiki> MyDir</span>
The idealized and realistic ROMS Test Cases and the Matlab processing software can be downloaded from:


where '''MyDir''' is the destination directory on your local computer. It will be created if not found. If your want to avoid typing your '''username''' for all future code updates, change the command to:
    > <span class="red">git clone <nowiki>https://github.com/myroms/roms_test.git </nowiki></span>
    > <span class="red">git clone <nowiki>https://github.com/myroms/roms_matlab.git</nowiki></span>


    <span class="red">git clone <nowiki>https://joe_roms@www.myroms.org/svn/src/trunk</nowiki> MyDir</span>
We highly recommend that Users clone all the ROMS repositories from the same root directory in their computer and define the '''ROMS_ROOT_DIR''' variable in their computer shell login environment, specifying where the User cloned/downloaded the ROMS source code, Test Cases, and Matlab processing software. That is, use the value of pwd from the computer directory where you executed git clone https://github.com/myroms/roms.git


You only clone once because Git will keep track of the source, destination and a bunch of other information. For more detail on command line use and syntax, see the [https://git-scm.com/book/en/v2 Pro Git] book.
For bash shells:
    export ROMS_ROOT_DIR=MyDownlodLocationDirectory


Several GUI front-ends to Git exist, allowing the user to have visual prompts to help them manage their files and credentials.
For csh/tcsh shells:
    setenv ROMS_ROOT_DIR  MyDownlodLocationDirectory
 
The build scripts will use this environmental variable when compiling any of the ROMS Test Cases without the need to customize the location of the ROMS source code. Also, it is used for loading the path of Matlab scripts in the startup.m configuration file.


===Updates===
===Updates===
Line 35: Line 59:
Now and again, you might feel the urge to get up to speed with the latest changes that have been made to the ROMS repository. When that happens, simply go to the directory that was "MyDir" above and type:
Now and again, you might feel the urge to get up to speed with the latest changes that have been made to the ROMS repository. When that happens, simply go to the directory that was "MyDir" above and type:


     <span class="red">git pull</span>
     > <span class="red">git pull</span>
 
Git will remember where you checked out from before and see if a newer revision exists. If so, it will download and apply all the relevant changes.
 
==Managing Your Own Modifications==
This assumes that you have a fresh clone of the myroms repository on the '''develop''' branch. You want to keep '''develop''' as a pure copy of the source version and keep your own changes in say the '''arctic''' branch. Start by creating a branch and switching to it:
 
> <span class="red">git branch arctic<br /></span>> <span class="red">git checkout arctic</span>
 
Now you can make whatever modifications you like (and test them out). To see what changed, you can use <span class="red">git status</span> and <span class="red">git diff</span>. To save your changes, do a:
 
> <span class="red">git commit -a</span>
 
Though if you add new files you will have to <span class="red">git add</span> them first.
 
===Getting the Updates===
It is easy to fetch and merge the updates. Start by making sure your directory has been cleanly checked in with <span class="red">git status</span>.  Then you can update your '''develop''' branch:
 
> <span class="red">git checkout develop</span><br />> <span class="red">git pull</span>


Subversion will remember where you checked out from before and see if a newer revision exists. If so, it will download and apply all the relevant changes.
Then bring the changes into your '''arctic''' branch:


==Saving ROMS login credentials==
> <span class="red">git checkout arctic</span><br />> <span class="red">git merge develop</span>
There are a few different options for storing your ROMS login credentials in order to avoid having to type your username and password for every command. See [https://git-scm.com/book/en/v2/Git-Tools-Credential-Storage here] for more details.


This will bring in everything that changed since your last <span class="red">git pull</span>, so you might find it easier to keep on top of things by doing this often, not putting it off for years. You can also bring in changes one at a time with <span class="red">git cherry-pick</span>. Again, check the Pro Git book for much more information about all of these operations.


==Using GUI Git Clients==
Note that this will save your '''arctic''' branch locally, under the .git directory. You can back this up as you would any other important files you have.
{{warning}}'''WARNING:''' It is strongly suggested that you checkout the ROMS source code using the same operating system you wish to compile and run ROMS on. If you download the code on a Windows machine and wish to run it on a non-Windows machine you will need convert the line endings with a utility like <span class="red">dos2unix</span> or <span class="red">recode</span>. Even with these utilities you may still have problems compiling ROMS.


==Useful Git Commands==
{| border="1" cellspacing="0" cellpadding="5" align="center"
|'''Command'''
|'''Description'''
|-
| '''git add''' <_FileName_>
| Add a file to the repository staging area
|-
| '''git branch'''
| List all local branches (the asterisk denotes the current branch)
|-
| '''git branch -a'''
| List all local and remote branches
|-
| '''git branch -d''' <_BranchName_>
| Delete a local branch
|-
| '''git branch -D''' <_BranchName_>
| Delete a local branch forcefully
|-
| '''git branch -m''' <_OldName_> <_NewName_>
| Rename a local branch
|-
| '''git checkout -b''' <_BranchName_>
| Create a new local branch and switch to it
|-
| '''git checkout''' <_BranchName_>
| Switch to an existing local or remote branch
|-
| '''git clone''' <_RepositoryURL_>
| Clone a public repository
|-
| '''git commit -am''' "<_Message_>"
| Commit changes to all files
|-
| '''git commit -am''' "<_Message_>" '''-m''' "<_MessageURL_>"
| Commit changes to all files with two message lines
|-
| '''git commit --amend -m''' "<_NewMessage_>"
| Amend previous commit message
|-
| '''git diff'''
| Show all changes between HEAD and working branch
|-
| '''git diff''' <_FileName_>
| Show changes for a specific file between HEAD and working branch
|-
| '''git difftool -d''' <_BranchName1_> <_BranchName2_>
| Compare the difference between two branches with '''`KDIFF3`'''
|-
| '''git fetch'''
| Retrieve new work done by other people
|-
| '''git log'''
| View repository changes
|-
| '''git log --oneline'''
| Show the list of commits in one-line format
|-
| '''git log --summary'''
| View repository detailed changes
|-
| '''git merge --no-ff --no-commit''' <_BranchName_>
| Merge a branch into the active branch
|-
| '''git pull'''
| Update local repository or branch to the newest origin commit
|-
| '''git push origin --delete''' <_BranchName_>
| Delete a remote branch
|-
| '''git push -u origin''' <_BranchName_>
| Push changes to the remote repository (and remember the branch)
|-
| '''git reset --hard HEAD~1'''
| Undo last commit
|-
| '''git revert''' <_CommitID_>
| Revert commit changes
|-
| '''git status'''
| Check/display changes to the repository or particular branch
|-
| '''git tag'''
| List all tags
|}


Once we have some experience with some GUI Git clients, we will add to this section.


===View the Repository===
==Complicated Commands==
The easiest way to view a repository is to simply look at it with [http://trac.edgewall.org/ Trac] in a web browser. Enter the URL:


https://www.myroms.org/projects/git-src/login
If a branch is renamed in a repository on GitHub, the local clone on a computer needs to updated:<div class="box">git branch -m OldName NewName<br />git fetch origin<br />git branch -u origin/NewName NewName<br />git remote set-head origin -a</div>


and log in with your ROMS credentials. Once logged in click the '''Browse Source''' tab near the top of the page. This is also a good way to see individual files in the repository without actually downloading them.
How to merge changes in the '''feature/name1''' branch into the '''feature/name2''' branch:<div class="box">git checkout feature/name1<br />git pull<br /><br />git checkout feature/name2<br />git pull<br />git merge --no-ff --no-commit feature/name1<br />git commit -am "Merging feature/name1 into feature/name2" -m "MessageURL"<br />git difftool -d feature/name1 feature/name2<br />git push -u origin feature/name2</div>

Latest revision as of 17:51, 24 January 2024

Git

ROMS source code is now distributed using Git. The Subversion(SVN) repository is being phased out and will no longer be updated starting January 1st, 2025. The GitHub repository includes the full history of changes to the ROMS source code. There are command line and GUI Git clients available for nearly every operating system and a list of popular clients can be found here. This page will help you get started with downloading ROMS with Git.


NoteNote: For instructions using the deprecated and soon to be discontinued myroms.org git repository, click here.


NoteNote: Details on using the deprecated and soon to be discontinued Subversion repository can be found here.


Git Overview

Git is a free and open source distributed version control system designed to handle everything from small to very large projects with speed and efficiency. All the ROMS/TOMS files are stored in a Git repository on github.com.

This Git repository is the official version of the code which only the developers are allowed to change. Users should download the ROMS code to their local machines using a git client. Don't attempt to use a regular web browser to browse or download files from the Git repository - there are much better tools for interacting with the code repository.

We strongly recommend users always check out the current develop version since this has the most recent updates and bug fixes. The tags are kept largely as a historical record of stable releases at the conclusion of major code upgrades.

If you are making changes of your own, keep them in a separate branch, leaving the develop branch to track changes from the source. Git makes it so much easier to manage your own modifications than svn for those of us without write permission on the repository.

Below is a general description of how Git works. Please look at the Pro Git book for more detailed information. We have not yet tried any GUI clients but may add brief how-tos for the most popular GUIs at a later date.

Configuring GIT

Before downloading any of ROMS repositories, ensure that your ~/.gitconfig has the appropriate git-lfs configuration for correctly downloading some roms_test input and observation NetCDF files. Otherwise, the Test Cases requiring input NetCDF files will fail. The Git LFS is a command line extension and specification for managing large files with Git. A sample of the configuration file looks like this:

more ~/.gitconf

[User]
name = GivenName MiddleName FamilyName
email = your@email
[credential]
helper = cache --timeout=7200
helper = store --file ~/.my-credentials
[filter "lfs"]
clean = git-lfs clean -- %f
smudge = git-lfs smudge -- %f
process = git-lfs filter-process
required = true

Alternatively, you may execute git lfs pull at your location of this repository to download a viable version of the Git LFS files from the remote repository in GitHub. Also, to automatically add the LFS filter to your existing ~/.gitconfig, you could use git lfs install from anywhere in your computer directories.

Downloading ROMS

WarningWARNING: It is strongly suggested that you clone the ROMS source code using the same operating system you wish to compile and run ROMS on. If you download the code on a Windows machine and wish to run it on a non-Windows machine you will need convert the line endings with a utility like dos2unix or recode. Even with these utilities you may still have problems compiling ROMS.


In order download source code from a git repository, git client software must be installed on your local machine. Most Linux distributions come with git, so shell commands may be used without installing additional software. The general form of git commands is:

   git action <repository>

To check-out the files from the ROMS repository develop (latest version), enter (notice https instead of http):

   > git clone https://github.com/myroms/roms.git MyDir

where MyDir is the destination directory on your local computer. It will be created if not found. If MyDir is omitted the code will be downloaded to a directory named roms. You only clone once because Git will keep track of the source, destination and a bunch of other information. For more detail on command line use and syntax, see the Pro Git book.

The idealized and realistic ROMS Test Cases and the Matlab processing software can be downloaded from:

   > git clone https://github.com/myroms/roms_test.git 
   > git clone https://github.com/myroms/roms_matlab.git

We highly recommend that Users clone all the ROMS repositories from the same root directory in their computer and define the ROMS_ROOT_DIR variable in their computer shell login environment, specifying where the User cloned/downloaded the ROMS source code, Test Cases, and Matlab processing software. That is, use the value of pwd from the computer directory where you executed git clone https://github.com/myroms/roms.git

For bash shells:

   export ROMS_ROOT_DIR=MyDownlodLocationDirectory

For csh/tcsh shells:

   setenv ROMS_ROOT_DIR  MyDownlodLocationDirectory

The build scripts will use this environmental variable when compiling any of the ROMS Test Cases without the need to customize the location of the ROMS source code. Also, it is used for loading the path of Matlab scripts in the startup.m configuration file.

Updates

Now and again, you might feel the urge to get up to speed with the latest changes that have been made to the ROMS repository. When that happens, simply go to the directory that was "MyDir" above and type:

   > git pull

Git will remember where you checked out from before and see if a newer revision exists. If so, it will download and apply all the relevant changes.

Managing Your Own Modifications

This assumes that you have a fresh clone of the myroms repository on the develop branch. You want to keep develop as a pure copy of the source version and keep your own changes in say the arctic branch. Start by creating a branch and switching to it:

> git branch arctic
> git checkout arctic

Now you can make whatever modifications you like (and test them out). To see what changed, you can use git status and git diff. To save your changes, do a:

> git commit -a

Though if you add new files you will have to git add them first.

Getting the Updates

It is easy to fetch and merge the updates. Start by making sure your directory has been cleanly checked in with git status. Then you can update your develop branch:

> git checkout develop
> git pull

Then bring the changes into your arctic branch:

> git checkout arctic
> git merge develop

This will bring in everything that changed since your last git pull, so you might find it easier to keep on top of things by doing this often, not putting it off for years. You can also bring in changes one at a time with git cherry-pick. Again, check the Pro Git book for much more information about all of these operations.

Note that this will save your arctic branch locally, under the .git directory. You can back this up as you would any other important files you have.

Useful Git Commands

Command Description
git add <_FileName_> Add a file to the repository staging area
git branch List all local branches (the asterisk denotes the current branch)
git branch -a List all local and remote branches
git branch -d <_BranchName_> Delete a local branch
git branch -D <_BranchName_> Delete a local branch forcefully
git branch -m <_OldName_> <_NewName_> Rename a local branch
git checkout -b <_BranchName_> Create a new local branch and switch to it
git checkout <_BranchName_> Switch to an existing local or remote branch
git clone <_RepositoryURL_> Clone a public repository
git commit -am "<_Message_>" Commit changes to all files
git commit -am "<_Message_>" -m "<_MessageURL_>" Commit changes to all files with two message lines
git commit --amend -m "<_NewMessage_>" Amend previous commit message
git diff Show all changes between HEAD and working branch
git diff <_FileName_> Show changes for a specific file between HEAD and working branch
git difftool -d <_BranchName1_> <_BranchName2_> Compare the difference between two branches with `KDIFF3`
git fetch Retrieve new work done by other people
git log View repository changes
git log --oneline Show the list of commits in one-line format
git log --summary View repository detailed changes
git merge --no-ff --no-commit <_BranchName_> Merge a branch into the active branch
git pull Update local repository or branch to the newest origin commit
git push origin --delete <_BranchName_> Delete a remote branch
git push -u origin <_BranchName_> Push changes to the remote repository (and remember the branch)
git reset --hard HEAD~1 Undo last commit
git revert <_CommitID_> Revert commit changes
git status Check/display changes to the repository or particular branch
git tag List all tags


Complicated Commands

If a branch is renamed in a repository on GitHub, the local clone on a computer needs to updated:

git branch -m OldName NewName
git fetch origin
git branch -u origin/NewName NewName
git remote set-head origin -a

How to merge changes in the feature/name1 branch into the feature/name2 branch:

git checkout feature/name1
git pull

git checkout feature/name2
git pull
git merge --no-ff --no-commit feature/name1
git commit -am "Merging feature/name1 into feature/name2" -m "MessageURL"
git difftool -d feature/name1 feature/name2
git push -u origin feature/name2