1
Br
oc
hure
For Public Auditors
Data Analysis Tools:
Sampling Methods, Use of CAAT,
IT Systems for Risk Based Audit
12
th– 13
thJune 2014, Berlin
With experts from:
•
Swedish National Audit Office
•
General Inspection of Social Affairs (IGAS), France
•
Information and Analysis, Audit Commission, United Kingdom
•
Central Audit Service, Ministry of Finance, the Netherlands
•
Cass Business School, City University London, United Kingdom
2
Who is this seminar for?
• Internal and External Auditors
• Audit methodologists
• Audit statisticians
• Audit experts
• Controllers
• Evaluation officers
• Quality managers
• Policy makers
working in
• Public administrations on national and
regional level
• Subordinate government bodies
• Universities and Higher Education
Institutes
• European Institutions and Agencies
• International Organisations and NGOs
especially from the following
departments
• Internal Audit
• Internal Oversight
• Inspection
• Financial Control
• Management Support
• Quality Assurance
• International Cooperation
This seminar might be also interesting
for private audit companies working
with and for the public sector.
ADVANCED SEMINAR
Data Analysis Tools: Sampling Methods,
Use of CAAT, IT Systems for Risk Based Audit
Data Analysis – Setting the right course for your audit
The amount of information being processed and thus needing to be audited continuously
increases. To keep up with this heightened complexity, it is crucial to stay up-to-date on the
latest developments in the field and optimise the use of existing tools and procedures. In
order to set the right course, a thorough understanding of the different data analysis steps
and methods significantly solidifies the basis of both internal and external audits.
Choosing the right tools to receive convincing audit results
The chosen sampling method is still an important factor when dealing with comprehensive
analyses in audit. However, the impact of data analysis software on accuracy and efficiency
of audit procedures is vast and an important trend in public auditing. This development cannot
be disregarded, whether you are already using advanced software solutions or relying on
more traditional applications. Computer Assisted Audit Techniques (CAATs) allow you as
an auditor to process great volumes of data. This may lead to the discovery of indications
of fraud and other irregularities hidden in the jungle of numbers and spreadsheets or even
help to identify benchmarks in value for money audits.
When dealing with data analysis, practitioners are often confronted with questions such as:
• How to best collect data systematically
• What measures have to be taken when needed data is not available?
• How can you correctly evaluate sample findings?
• How do other experienced public institutions handle IT tools in their audits?
• What are the advantages of continuous auditing?
Consolidate and deepen your knowledge on the different evidence collection methods
presented in this advanced seminar and identify the optimal procedure for each of your
comprehensive audit missions.
3
What will you learn at this seminar?
• How can you determine inherent and control risks for your management
and control system?
• How to calculate the confidence level
• Which sampling method is the adequate choice for my audit?
• How to determine the sample size
• What are the benefits and challenges of different data-gathering tools?
• Which review technique is of the greatest value in which audit situation?
• How do you evaluate your findings correctly?
• What can you do when data is nonexistent?
• How can the right data analysis method improve your value for money audits?
• How to analyse data most effectively
• Which advantages does continuous auditing have for your institution?
Your benefits
• Familiarise yourself with the toolkit for
public auditors
• Get well-rounded audit results
– Improve the quality of your audit
findings
• Be proactive – Professionalise audits in
your organization
• Gain valuable insight into internal
audit practices in other countries and
institutions – Benefit from best practice
examples
• Get in-depth knowledge of the most
important engagement tools for auditors
in the public sector
• Consult your individual questions and
problems with our experts and receive
practical advice and real solutions for
your audits
• Network and exchange experiences
with our experts and international
colleagues who deal with public sector
audits
“Interesting and helpful practical examples!”
4
Case Study
11.00-11.45
Handling Data: Lessons Learnt in
Four Cases
12.00-12.45
Using Public Data to Profile Local
Authorities for an Optimised Value
for Money Audit
8.30-9.00
Registration and Handout of Seminar Material
9.00-9.05
Opening Remarks from the European Academy for Taxes, Economics
& Law
9.05-9.30
Welcome Note from the Chair and Round of
Introductions
Dimitrios Ioannidis, Audit Coordinator,
Swedish National Audit Office
9.30-10.15
Auditing Strategies for Data Access and
Data Presentation
• Key factor in Auditing: Data Analysis
• What to do when data is nonexistent
• A difficult situation: When data needs to be presented in different
ways than has been done by the audit object
Dimitrios Ioannidis, Audit Coordinator,
Swedish National Audit Office
The views expressed in his presentation are solely those of the speaker himself and do not represent the official position of the Swedish National Audit Office. 10.15-10.30
Discussion Round
10.30-11.00
Coffee Break and Networking Opportunity
• A state’s ownership of digital infrastructure
• The state as a user of IT and communication services
• Regulatory decisions of a Post and Telecom Authority (PTS)
• Delays in a railway system
Dimitrios Ioannidis, Audit Coordinator,
Swedish National Audit Office
The views expressed in his presentation are solely those of the speaker himself and do not represent the official position of the Swedish National Audit Office.
11.45-12.00
Discussion Round
• How profiles of local authorities were created to support a
programme of value for money (VFM) audit
• Development of profiles in response to changes in audit
methodology
• Steps required to build and operate the VFM profiles
• Lessons learnt
Mark Burkett, Performance Analyst, Information and
Analysis, Audit Commission, United Kingdom
12.45-13.00
Discussion Round
13.00-14.00
Lunch Break and Networking Opportunity
PROGRAMME DAY 1
Data Analysis Tools: Sampling Methods,
Use of CAAT, IT Systems for Risk Based Audit
DIMITRIOS IOANNIDIS
Audit Coordinator, Swedish
National Audit Office
Since 2006, Dimitrios Ioannidis is
Audit Coordinator at the Swedish
National Audit Office. He has audited
procurement processes linked to
the sale of state owned companies
as well as the purchase of IT and
telecom services in the government
sector. In 2005, he was Secretary in a Government
of Committee, dealing with the review of the Swedish
National Premium Pension system. Between 2001
and 2006, he was Economist at the Financial Stability
Department of the Central Bank of Sweden, and
participated in the procurement of a new system for the
settlement of large payments. Between 1990 and 2001,
he was researcher and lecturer at the Stockholm School
of Economics. His research focused on the importance
of buyer/seller relationship for industrial and corporate
development. The views expressed in his presentation
are solely those of the speaker himself and do not
represent the official position of the Swedish National
Audit Office.
MARK BURKETT
Performance Analyst, Information and
Analysis, Audit Commission,
United Kingdom
Mark Burkett joined the Audit Commission in 2001
and has worked on a range of programmes. These
include value for money research, developing audit
and inspection methodologies and combining statistical
analysis and data management in online tools. Prior
to joining the Commission, he worked in a number of
English local authorities and as an auditor specialising
in performance work.
5
Case Study
14.00-14.45
Developing and Using Benchmarks
as Part of Value for Money Audit
• Access to comparative data
• Using data to develop benchmarks
• Identifying and understanding key features of data
• Applying benchmarks based on the key features of data
• Limitations of statistical exercise
Mark Burkett, Performance Analyst, Information and
Analysis, Audit Commission, United Kingdom
14.45-15.00
Discussion Round
15.00-15.30
Coffee Break and Networking Opportunity
15.30-16.15
How ISA 530 is Applied in the Audit of a
National Government – Best Practice
• Place of statistical sampling in the audit risk model
• Evaluation of findings
• Impact of corrections on the evaluation
• Difference of most likely error and upper error limit
Wim Slot, Audit Manager, Central Audit Service,
Ministry of Finance, the Netherlands
16.15-16.30
Discussion Round
16.30
End of Day One
WIM SLOT
Audit Manager, Central Audit
Service, Ministry of Finance,
the Netherlands
Since 1995, Wim Slot is involved
in the audit of the accounts of the
Dutch Ministry of Foreign Affairs.
This includes the commitments
and expenditures for development
cooperation, which is the largest part of his audit work.
Started as just graduated auditor, he became an audit
manager in 1997 and senior audit manager in 2002.
For several years he has been member of the technical
committee within the Central Audit Service. In this
position Wim Slot contributed to the audit manual that
was written in 2011.
6
PROGRAMME DAY 2
Data Analysis Tools: Sampling Methods,
Use of CAAT, IT Systems for Risk Based Audit
9.00-9.15
Welcome Note from the Chair
Andrew Robertson, Senior Fellow, Faculty of
Management, Cass Business School,
City University London, United Kingdom
9.15-10.00
Handling Data Samples
• Introduction to sampling (definitions, principal features of the
population, characteristics, stratification)
• Statistical and non-statistical approach to sampling
• Statistical terminology
• Risk analysis
• Statistical sampling methods (MUS)
• Evaluation of the audit results
Marianna Miklós-Molnár, Director of Strategy and
Methodology, Directorate General for Audit of
European Funds, Ministry of National Economy,
Hungary
10.00-10.15
Discussion Round
10.15-10.45
Coffee Break and Networking Opportunity
10.45-11.30
Using Computer Assisted Audit Techniques
(CAAT) in the Audit Process
• The benefit of using CAATs
• Most widely used CAATs
• Data Analysis
• Pros and cons of the different IT tools
• Big data
Andrew Robertson, Senior Fellow, Faculty of
Management, Cass Business School,
City University London, United Kingdom
11.30-11.45
Discussion Round
ANDREW ROBERTSON
Senior Fellow, Faculty of
Management, Cass Business
School, City University
London, United Kingdom
Andrew Robertson has over 35
years experience in auditing
and risk management, covering
manufacturing,
retail,
financial
services and the not for profit sectors. He has been Head
of Audit in several blue chip organisations, and Head of
Risk in two organisations. During this time, he has been
instrumental in both uncovering and resolving many
organisational problems. He is a Senior Visiting Fellow at
Cass Business School and until recently was managing
and delivering modules on audit and risk related topics to
MSc students at the Business School. Andrew Robertson
delivers lectures and workshops in risk and audit related
areas, particularly in fraud detection and prevention as
well as the establishment of risk management systems.
He has worked extensively in developing and transition,
including China, Hungary, Poland, Romania, Slovakia
and South Africa. His most recent assignments have
been on behalf of the Commonwealth Secretariat to
Trinidad, Barbados and Mauritius, and with the World
Bank in Ghana. His work has taken him to 60 countries.
MARIANNA
MIKLÓS-MOLNÁR
Director of Strategy and
Methodology, Directorate
General for Audit of European
Funds, Ministry of National
Economy, Hungary
Marianna Miklós-Molnár has been
working at the Hungarian Ministry of National Economy
for many years. During this period as Auditor she has
been involved in sample and system audits and risk
analyses related to ERDF, ESF and CF funding. Since
2008, Marianna Miklós-Molnár has been involved in
strategy development, sampling, planning and reporting
activities. In 2010, she was appointed Director of Strategy
and Methodology within the Directorate General for Audit
of European Funds.
“To the point.”
“A great opportunity to exchange experiences with other experts.”
7
Case Study
11.45-12.30
Use of CAAT (IDEA®) by a Non
Specialised Auditor in Three
Different Contexts
• Presentation of IGAS, nature of missions, auditor profile – a long
term but non frequent use of the tool in non repetitive audits
• Use in the case of child protection by local authorities
• Use in the case of procurement audit
• Use in the case of the audit of asset management by retirement
pension funds
• Pros and cons of using a data extraction and analysis software,
conditions of an efficient use
Pascal Penaud, Inspector General,
General Inspection of Social Affairs (IGAS), France
12.30-12.45
Discussion Round
12.45-14.00
Lunch Break and Networking Opportunity
14.00-14.45
Continuous Monitoring and Audit
in Public Institutions
• Principles of continuous auditing
• Bridging the assurance gap
• 3 lines of defence
• Differences between sampling and continuous auditing
• Advantages of continuous monitoring and audit
• Arising risks and how to avoid them
Andrew Robertson, Senior Fellow, Faculty of
Management, Cass Business School,
City University London, United Kingdom
14.45-15.00
Discussion Round
15.00-15.30
Coffee Break and Networking Opportunity
15.30-16.15
Using IT Systems for Risk Based Internal
Auditing
• Added value through risk based internal audit
• Aligning the risks with the organisation’s goal
• Risk management and IT developments
Andrew Robertson, Senior Fellow, Faculty of
Management, Cass Business School,
City University London, United Kingdom
16.15-16.30
Final Discussion Round
16.30
End of Seminar and Handout of Certificates
ANDREW ROBERTSON
Senior Fellow, Faculty of
Management, Cass Business
School, City University
London, United Kingdom
Andrew Robertson has over 35
years experience in auditing
and risk management, covering
manufacturing,
retail,
financial
services and the not for profit sectors. He has been Head
of Audit in several blue chip organisations, and Head of
Risk in two organisations. During this time, he has been
instrumental in both uncovering and resolving many
organisational problems. He is a Senior Visiting Fellow at
Cass Business School and until recently was managing
and delivering modules on audit and risk related topics to
MSc students at the Business School. Andrew Robertson
delivers lectures and workshops in risk and audit related
areas, particularly in fraud detection and prevention as
well as the establishment of risk management systems.
He has worked extensively in developing and transition,
including China, Hungary, Poland, Romania, Slovakia
and South Africa. His most recent assignments have
been on behalf of the Commonwealth Secretariat to
Trinidad, Barbados and Mauritius, and with the World
Bank in Ghana. His work has taken him to 60 countries.
PASCAL PENAUD
Inspector General, General
Inspection of Social Affairs
(IGAS), France
Since 2003, Pascal Penaud is
Inspector General at the Inspection
Générale des Affaires Sociales
(IGAS) which is an inter-ministerial
audit and evaluation office for
social, health, employment and labour policies that
assists public players in making informed decisions. As
Inspector General, he is also responsible for auditing
public procurement in various major French hospitals as
well as social ministries. Prior, Pascal Penaud was Head
of the information system department of the Ministry of
Health. For his diverse audit assignments he has been
using the audit software IDEA since 1998.
8
Date of Event
12
th– 13
thJune 2014, Berlin
Booking Number
S-787
Event Language
The event language will be English.
Event Price
1.389,- Euro excl. German VAT (19%)
The above price covers the following:
• Admission to the seminar
• Hand-out documents
• Seminar certificate, if seminar fully attended
• Soft drinks and coffee/tea on both event days
• Lunch on both event days
Upon request you can receive a
digital version of the seminar
documents after the event for
60,- Euro excl. German VAT (19%)
in addition to the seminar.
Contact
European Academy for Taxes, Economics & Law
At Potsdamer Platz, Entrance Leipziger Platz 9,
10117 Berlin, Germany
Phone: +49 (0)30 80 20 80 230
Fax:
+49 (0)30 80 20 80 250
E-mail: [email protected]
Internet: www.euroacad.eu
Your contact persons for the programme:
Regina Lüning, M. Sc. econ.
Head of Marketing and Sales
Phone: +49 (0)30 80 20 80 246
Fax:
+49 (0)30 80 20 80 259
E-mail: [email protected]
Laura Hentz M.A.
Conference Manager
Phone: +49 (0)30 80 20 80 244
Fax:
+49 (0)30 80 20 80 259
E-mail: [email protected]
(Programme is subject to alterations)
Event Location
Maritim Hotel Berlin
Stauffenbergstraße 26
10785 Berlin, Germany
Phone: +49 (0)30 2033 4410
Fax:
+49 (0)30 2033 4092
E-Mail: [email protected]
Internet: www.maritim.de
Please contact the hotel directly and refer to the “European Academy
for Taxes, Economics & Law” if you wish to benefit from a limited
room availability-contingent. Of course you can always look for an
alternative hotel accommodation.
ORGANISATIONAL MATTERS
Data Analysis Tools: Sampling Methods,
Use of CAAT, IT Systems for Risk Based Audit
BOOKING
E-mail: [email protected]
Phone: +49 (0)30 80 20 80 230
Fax:
+49 (0)30 80 20 80 250
For online booking please visit
our website: www.euroacad.eu
9
BOOKING
BOOKING NUMBER
:
S-787 (PR)
12
th- 13
thJUNE 2014, BERLIN
Herewith we register the following persons for the Advanced Seminar: “Data Analysis Tools: Sampling Methods, Use of CAAT, IT Systems for Risk Based
Only Valid with Signature and Stamp.
NOTE
European Academy for Taxes, Economics & Law Brauner Klingenberg GmbH | Leipziger Platz 9 | 10117 Berlin | Phone +49 (0)30 80 20 80 230 | Fax +49 (0)30 80 20 80 259
Place, Date
Authorised Signature and Stamp
Phone
Fax
Ms.
Mr.
Delegate 1
I hereby order the digital version of the
seminar documents (fee required) in addition
to the seminar.
First name
Last name
Your organisation
Department
Unit
Job position
Street
Postcode / City
Country
Phone
Fax
Ms.
Mr.
Delegate 2
I hereby order the digital version of the
seminar documents (fee required) in addition
to the seminar.
First name
Last name
Your organisation
Department
Unit
Job position
Street
Postcode / City
Country
Phone
Fax
Ms.
Mr.
Delegate 3
I hereby order the digital version of the
seminar documents (fee required) in addition
to the seminar.
First name
Last name
Your organisation
Department
Unit
Job position
Street
Postcode / City
Country
In case of registration of more than one delegate do you prefer:
single invoice?
collective invoice?
Ms.
Mr.
Invoice Organisation
With my signature I confirm my registration and accept the
General Terms and Conditions as legally binding.
I herewith agree to receive further information from the
European Academy for Taxes, Economics & Law
First name
Last name
Your Organisation
Department
Unit
Job Position
Street
Postcode / City
Country
Phone
Fax
European Academy for Taxes, Economics & Law
at Potsdamer Platz
Entrance: Leipziger Platz 9
10117 Berlin / Germany
BOOKING
E-mail: [email protected]
Fax:
+49 (0)30 802080-250
Phone: +49 (0)30 802080-230
For online booking please visit
our website: www.euroacad.eu
10
Terms & Conditions for Conferences, Seminars and other
Training Courses
1. Area of Application
The following terms and conditions settle the contractual relationship between conference participants and the European Academy for Taxes, Economics & Law Brauner Klin- genberg GmbH [referred to as “European Academy for Taxes, Economics & Law” in the following]. Differing terms and conditions, as well as, other settlements and/or regulati-ons have no validity.
2. Registration / Confirmation of Application
A registration can be made via internet, mail, fax, or email. The registration is considered granted and legally binding if not rejected by the European Academy for Taxes, Eco-nomics & Law in writing within seven (7) days after receipt of registration. The registration will be supplemented by a booking confirmation via email. Partial bookings are only valid for seminars designed in modules. 3. Service The course fee covers the fee per participant and course in € net, subject to current German VAT. It includes training course documents as per course description, a lunch meal/ snack and refreshments during breaks, as well as, a participation certificate. The European Academy for Taxes, Economics & Law has the right to change speakers/instructors and to modify the course program if and where necessary while maintaining the overall nature of the course. All registered participants will be notified in case of a course cancellation due to force majeure, due to speakers’ preventions, due to troubles at the chosen location or due to a low registration rate. Course cancellation notification due to a low registration rate is issued no later than two (2) weeks before the course date. Course fees are reimbursed in the cases listed above; however, reimbursement for travel expenses or work absenteeism is only granted in cases of intention or gross negligence by the European Academy for Taxes, Economics & Law. Any reimbursement of travel expenses are to be considered as an exceptional goodwill gesture and form no future ge-neral obligation. In case of disturbances and/or interruptions, the European Academy for Taxes, Economics & Law commits itself to solve or limit any problems that might occur in order to maintain and continue the course as planned.
4. Payment Date and Payment, Default of Payment
Payment of the course fee is payable immediately upon receipt of invoice. Where payment is not received or lacking clear assignment to a participant prior to commencement of the course, the European Academy for Taxes, Economics & Law may refuse the relevant participant’s participation in that course. The course fee, however, is still due immedia-tely and can be claimed as part of a dunning procedure or legal action. In accordance with BGB §247 (1), in case of default of payment within the stipulated time period, default interest on arrears of at least 5% above the ECB base rate is due and payable. The European Academy for Taxes, Economics & Law can claim higher damage for delay if and where proven. Equally, the participant may prove that a damage has not occurred or has had less effect than estimated by the European Academy for Taxes, Economics & Law. Payment shall be made by cashless bank transfer; cash or cheques will not be accepted. The European Academy for Taxes, Economics & Law is not liable for any loss of means of payment. The participant may only offset such claims against the European Academy for Taxes, Economics & Law’s as are undisputed, legally recognized or recognized in writing by the European Academy for Taxes, Economics & Law. The right of retention is only acceptable in accordance with a counterclaim based on the same contract. 5. Cancellation Cancellations need to be issued in writing. Cancellation by the participant will be subject to cancellation charges as follows: • 30 days or more prior to commencement of the course: service charge of 80,00 € net, subject to current German VAT, payable immediately, course fee will be reimbursed, • two (2) weeks to 30 days prior to commencement of the course: 50% of course fee net, subject to current German VAT, payable immediately, • non-attendance or cancellation less than two (2) weeks prior to commencement of the course: 100% of course fee net, subject to current Germany VAT, payable immediately The European Academy for Taxes, Economics & Law gladly accepts without additional costs a substitute participant nominated in case of a cancellation if the substitute parti-cipant is registered at least three (3) days prior to the commencement of the course. Neither cancellation of a specific module/part of the course or substitution per module/per day is possible. 6. Copyright Seminar/course documents are protected by property rights and may not be duplicated, processed, amended, circulated or published in any other way without the written con-sent of the European Academy for Taxes, Economics & Law. The European Academy for Taxes, Economics & Law reserves all rights. 7. Liability All seminars and courses are prepared and presented by qualified speakers and instructors. The European Academy for Taxes, Economics & Law accepts no liability for the up-to-dateness, correctness and completeness of the seminar documentation, as well as, presentation of the seminar.
8. Applicable Law, Place of Jurisdiction, Place of Performance
All cases shall be governed and construed in accordance with German law to the exclusion of the UN Sales Convention. As far as legally admissible, place of performance and place of exclusive jurisdiction shall be Berlin, Germany. 9. Data Protection The European Academy for Taxes, Economics & Law protects personal data by taking appropriate protection measures. For the purpose of optimization of the product and ser-vice portfolio and according to the regulations of the data privacy laws, it stores and processes person-specific data on the training participants. Hence, all European Academy for Taxes, Economics & Law website hits are registered. All personal data will, in accordance with the law, be used for documentation requests, placed orders or other enquiries in order to send information out by post. The European Academy for Taxes, Economics & Law will, in accordance with the law, inform participants by email about special offers that resemble previously booked semi-nars. If and where personal data needs to be transferred to countries lacking appropriate data protection schemes, the European Academy for Taxes, Economics & Law shall grant alternative adequate protection. Furthermore, the European Academy for Taxes, Economics & Law will use personal data as far as participants have granted respective permission. When collecting personal data, the European Academy for Taxes, Economics & Law will always ask for permission regarding email information about offers. The participant may, at any time, express their objection to data collection for the purpose of advertisement or address via email or fax. Any data provided to the European Academy for Taxes, Economics & Law will be processed for reservations and bookings, as well as, for information about other seminars. Names and company names will be published in a participants’ list and forwarded to the mailing company.